用动态3D高斯表示追踪心脏4D运动,无需大量训练数据。
Dyna3DGR: 4D Cardiac Motion Tracking with Dynamic 3D Gaussian Representation
- 结合显式3D高斯与隐式神经运动场,自监督优化结构与运动
- 在ACDC数据集上精度超越现有最先进方法,误差更小
- 适合心脏影像分析、医学图像配准研究者使用
准确分析心脏运动对评估心功能至关重要。尽管动态心脏磁共振成像(CMR)能捕捉整个心动周期的组织运动,但由于心肌组织同质性强、缺乏显著特征,精细的4D心脏运动追踪仍具挑战。现有方法分为基于图像和基于表示两类,前者易出现拓扑不一致或依赖大量训练数据,后者常损失图像级细节。为此,我们提出动态3D Gaussian表示(Dyna3DGR),融合显式3D高斯表示与隐式神经运动场建模,以自监督方式同时优化心脏结构与运动,无需大量训练数据或点对点对应关系。通过可微体积渲染,Dyna3DGR高效连接连续运动表示与图像空间对齐,同时保持拓扑与时间一致性。在ACDC数据集上的全面评估表明,该方法在追踪精度上优于现有的基于深度学习的微分配准方法。
原文摘要 · Abstract (English)
Accurate analysis of cardiac motion is crucial for evaluating cardiac function. While dynamic cardiac magnetic resonance imaging (CMR) can capture detailed tissue motion throughout the cardiac cycle, the fine-grained 4D cardiac motion tracking remains challenging due to the homogeneous nature of myocardial tissue and the lack of distinctive features. Existing approaches can be broadly categorized into image based and representation-based, each with its limitations. Image-based methods, including both raditional and deep learning-based registration approaches, either struggle with topological consistency or rely heavily on extensive training data. Representation-based methods, while promising, often suffer from loss of image-level details. To address these limitations, we propose Dynamic 3D Gaussian Representation (Dyna3DGR), a novel framework that combines explicit 3D Gaussian representation with implicit neural motion field modeling. Our method simultaneously optimizes cardiac structure and motion in a self-supervised manner, eliminating the need for extensive training data or point-to-point correspondences. Through differentiable volumetric rendering, Dyna3DGR efficiently bridges continuous motion representation with image-space alignment while preserving both topological and temporal consistency. Comprehensive evaluations on the ACDC dataset demonstrate that our approach surpasses state-of-the-art deep learning-based diffeomorphic registration methods in tracking accuracy. The code will be available in https://github.com/windrise/Dyna3DGR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。