从二维超声视频重建心脏4D动态模型,精度达98%以上。
Echo4DIR: 4D Implicit Heart Reconstruction from 2D Echocardiography Videos

- 用隐式表示结合先验形状,融合多视角特征解决几何模糊问题。
- 在真实临床数据上实现98.35%的Dice系数和96.75%的IoU,性能领先。
- 适合心脏病影像分析、手术规划等临床场景使用。
从稀疏的2D超声心动图视频中重建4D(3D+t)心脏结构极具价值,但受限于几何模糊和时间断续性。为此,我们提出Echo4DIR,一种新型测试时4D隐式重建框架。通过心脏条件隐式形状先验学习统计形状模型(SSM),设计基于视点交叉注意力的对极掩码编码器以有效融合多视角特征。为弥合合成与真实数据之间的域差距,引入自监督、针对SDF的可微渲染策略,仅用未校准的临床掩码即可实现患者特异性3D形状适配,无需3D真值。隐式表示的固有连续性克服了观测稀疏性,在任意分辨率下生成解剖可靠几何。此外,通过径向SDF对齐策略严格锁定形状演化与预测速度场,从根本上消除网格漂移。在合成基准和真实临床数据集上的大量实验表明,Echo4DIR实现了当前最优的4D心脏网格重建效果,尤其在临床重叠度上达到98.35% Dice和96.75% IoU。
原文摘要 · Abstract (English)
Reconstructing 4D (3D+t) cardiac geometry from sparse 2D echocardiography is highly desirable yet fundamentally challenged by geometric ambiguity and temporal discontinuity. To tackle these issues, we propose Echo4DIR, a novel test-time 4D implicit reconstruction framework. Specifically, we learn robust 3D shape priors from statistical shape models (SSMs) via a cardiac conditional SDF, constructing an Epipolar Mask Encoder module with epipolar cross attention to effectively fuse multi-view features. To bridge the synthetic-to-real domain gap, we introduce a self-supervised SDF-tailored differentiable rendering strategy for patient-specific 3D shape adaptation using uncalibrated clinical masks without requiring 3D ground truth. Crucially, the inherent continuity of implicit representation overcomes sparse observations, enabling anatomically reliable geometry at arbitrary resolutions. Furthermore, to empower our framework with physically continuous 4D extension, we introduce a Radial SDF Alignment strategy that strictly locks shape evolution to the predicted velocity field, fundamentally eliminating mesh drift. Extensive experiments on synthetic benchmarks and real clinical datasets demonstrate that Echo4DIR achieves state-of-the-art 4D cardiac mesh reconstruction, notably yielding an impressive clinical overlap of up to 98.35% Dice and 96.75% IoU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。