DeepMesh: Mesh-Based Cardiac Motion Tracking Using Deep Learning. 2024

Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert

3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and the diagnosis of cardiovascular diseases. Current state-of-the art methods focus on estimating dense pixel-/voxel-wise motion fields in image space, which ignores the fact that motion estimation is only relevant and useful within the anatomical objects of interest, e.g., the heart. In this work, we model the heart as a 3D mesh consisting of epi- and endocardial surfaces. We propose a novel learning framework, DeepMesh, which propagates a template heart mesh to a subject space and estimates the 3D motion of the heart mesh from CMR images for individual subjects. In DeepMesh, the heart mesh of the end-diastolic frame of an individual subject is first reconstructed from the template mesh. Mesh-based 3D motion fields with respect to the end-diastolic frame are then estimated from 2D short- and long-axis CMR images. By developing a differentiable mesh-to-image rasterizer, DeepMesh is able to leverage 2D shape information from multiple anatomical views for 3D mesh reconstruction and mesh motion estimation. The proposed method estimates vertex-wise displacement and thus maintains vertex correspondences between time frames, which is important for the quantitative assessment of cardiac function across different subjects and populations. We evaluate DeepMesh on CMR images acquired from the UK Biobank. We focus on 3D motion estimation of the left ventricle in this work. Experimental results show that the proposed method quantitatively and qualitatively outperforms other image-based and mesh-based cardiac motion tracking methods.

UI MeSH Term Description Entries
D008279 Magnetic Resonance Imaging Non-invasive method of demonstrating internal anatomy based on the principle that atomic nuclei in a strong magnetic field absorb pulses of radiofrequency energy and emit them as radiowaves which can be reconstructed into computerized images. The concept includes proton spin tomographic techniques. Chemical Shift Imaging,MR Tomography,MRI Scans,MRI, Functional,Magnetic Resonance Image,Magnetic Resonance Imaging, Functional,Magnetization Transfer Contrast Imaging,NMR Imaging,NMR Tomography,Tomography, NMR,Tomography, Proton Spin,fMRI,Functional Magnetic Resonance Imaging,Imaging, Chemical Shift,Proton Spin Tomography,Spin Echo Imaging,Steady-State Free Precession MRI,Tomography, MR,Zeugmatography,Chemical Shift Imagings,Echo Imaging, Spin,Echo Imagings, Spin,Functional MRI,Functional MRIs,Image, Magnetic Resonance,Imaging, Magnetic Resonance,Imaging, NMR,Imaging, Spin Echo,Imagings, Chemical Shift,Imagings, Spin Echo,MRI Scan,MRIs, Functional,Magnetic Resonance Images,Resonance Image, Magnetic,Scan, MRI,Scans, MRI,Shift Imaging, Chemical,Shift Imagings, Chemical,Spin Echo Imagings,Steady State Free Precession MRI
D009038 Motion Physical motion, i.e., a change in position of a body or subject as a result of an external force. It is distinguished from MOVEMENT, a process resulting from biological activity. Motions
D006321 Heart The hollow, muscular organ that maintains the circulation of the blood. Hearts
D006352 Heart Ventricles The lower right and left chambers of the heart. The right ventricle pumps venous BLOOD into the LUNGS and the left ventricle pumps oxygenated blood into the systemic arterial circulation. Cardiac Ventricle,Cardiac Ventricles,Heart Ventricle,Left Ventricle,Right Ventricle,Left Ventricles,Right Ventricles,Ventricle, Cardiac,Ventricle, Heart,Ventricle, Left,Ventricle, Right,Ventricles, Cardiac,Ventricles, Heart,Ventricles, Left,Ventricles, Right
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000077321 Deep Learning Supervised or unsupervised machine learning methods that use multiple layers of data representations generated by nonlinear transformations, instead of individual task-specific ALGORITHMS, to build and train neural network models. Hierarchical Learning,Learning, Deep,Learning, Hierarchical
D013526 Surgical Mesh Any woven or knit material of open texture used in surgery for the repair, reconstruction, or substitution of tissue. The mesh is usually a synthetic fabric made of various polymers. It is occasionally made of metal. Mesh, Surgical,Meshes, Surgical,Surgical Meshes

Related Publications

Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
December 2021, Medical physics,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
July 2020, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
October 2019, Nature,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
December 2023, IEEE transactions on ultrasonics, ferroelectrics, and frequency control,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
August 2008, IEEE transactions on medical imaging,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
June 2021, Sensors (Basel, Switzerland),
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
August 2022, Magnetic resonance in medicine,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
July 2003, Information processing in medical imaging : proceedings of the ... conference,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
August 2005, IEEE transactions on bio-medical engineering,
Qingjie Meng, and Wenjia Bai, and Declan P O'Regan, and Daniel Rueckert
December 2021, IEEE transactions on medical imaging,
Copied contents to your clipboard!