arXiv:2509.12090cs.CV2025-09中稿 · TMLR被引 2

用一套模型同时处理完整和稀疏心脏影像,实时重建4D心肌运动。

End-to-End 4D Heart Mesh Recovery Across Full-Stack and Sparse Cardiac MRI

  • 用可变形四面体统一建模心肌形状与运动,共享结构空间
  • 单张切片也能准确重建,零样本跨数据集测试表现领先
  • 仅需关键帧标注,适合临床介入场景实时应用

从心脏磁共振序列重建心肌运动对诊断、预后和手术干预至关重要。现有方法依赖完整的扫描数据堆栈来推断全心运动,限制了其在手术中仅能获取稀疏切片时的应用。本文提出TetHeart,首个端到端框架,可统一处理离线完整数据堆栈和术中稀疏切片的4D心肌网格重建。该方法利用可变形四面体在共享空间中捕捉心肌形状与运动。术前基于高质量完整数据初始化患者特异性心肌网格,术后可实时更新,即使仅获取单张切片亦可。TetHeart包含三项创新:(i) 注意力驱动的切片自适应2D-3D特征融合机制,支持任意数量和位置切片输入;(ii) 消融蒸馏策略,确保极端稀疏条件下的高精度重建;(iii) 弱监督运动学习,仅需关键帧(如舒张末期和收缩末期)标注。在三个公开大型数据集上训练并验证,零样本评估在额外私有介入及公开数据集上均达到当前最优性能,展现出强大泛化能力。代码与数据已开源于https://github.com/Scalsol/TetHeart。

原文摘要 · Abstract (English)

Reconstructing cardiac motion from CMR sequences is critical for diagnosis, prognosis, and intervention. Existing methods rely on complete CMR stacks to infer full heart motion, limiting their applicability during intervention when only sparse observations are available. We present TetHeart, the first end-to-end framework for unified 4D heart mesh recovery from both offline full-stack and intra-procedural sparse-slice observations. Our method leverages deformable tetrahedra to capture shape and motion in a coherent space shared across cardiac structures. Before a procedure, it initializes detailed, patient-specific heart meshes from high-quality full stacks, which can then be updated using whatever slices can be obtained in real-time, down to a single one during the procedure. TetHeart incorporates several key innovations: (i) an attentive slice-adaptive 2D-3D feature assembly mechanism that integrates information from arbitrary numbers of slices at any position; (ii) a distillation strategy to ensure accurate reconstruction under extreme sparsity; and (iii) a weakly supervised motion learning scheme requiring annotations only at keyframes, such as the end-diastolic and end-systolic phases. Trained and validated on three large public datasets and evaluated zero-shot on additional private interventional and public datasets without retraining, TetHeart achieves state-of-the-art accuracy and strong generalization in both pre- and intra-procedural settings. Code and dataset is available at https://github.com/Scalsol/TetHeart.

心脏建模4D重建稀疏数据临床应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。