用点云重建心脏四腔3D模型,突破MRI二维成像局限
HeartFormer: Semantic-Aware Dual-Structure Transformers for 3D Four-Chamber Cardiac Point Cloud Reconstruction
- 设计双结构注意力网络,融合全局与局部解剖语义信息
- 在1.7万例数据上实现高保真、几何一致的三维重建
- 适合心血管影像研究者,推动心脏病智能分析发展
我们提出首个基于点云表示的几何深度学习框架,用于从动态MRI数据中重建心脏四腔3D模型。该工作克服了传统cine MRI仅提供二维切片图像的长期局限,难以全面理解心脏形态与生理机制。为此,我们提出HeartFormer,一种将单类点云补全扩展至多类的新架构,包含两个核心组件:语义感知双结构变换器网络(SA-DSTNet)生成初始粗略点云,融合全局与子结构几何特征;语义感知几何特征精炼变换器网络(SA-GFRTNet)在此基础上逐步优化,有效利用全局与子结构几何先验,生成高质量且几何一致的重建结果。我们还构建了首个公开的大规模数据集HeartCompv1,包含17,000个高分辨率多类别心脏网格与点云,为该新兴方向建立通用基准。在HeartCompv1和UK Biobank上的跨域实验表明,HeartFormer性能稳定、准确且具备强泛化能力,持续优于现有最先进方法。代码与数据集将在论文录用后发布。
原文摘要 · Abstract (English)
We present the first geometric deep learning framework based on point cloud representation for 3D four-chamber cardiac reconstruction from cine MRI data. This work addresses a long-standing limitation in conventional cine MRI, which typically provides only 2D slice images of the heart, thereby restricting a comprehensive understanding of cardiac morphology and physiological mechanisms in both healthy and pathological conditions. To overcome this, we propose \textbf{HeartFormer}, a novel point cloud completion network that extends traditional single-class point cloud completion to the multi-class. HeartFormer consists of two key components: a Semantic-Aware Dual-Structure Transformer Network (SA-DSTNet) and a Semantic-Aware Geometry Feature Refinement Transformer Network (SA-GFRTNet). SA-DSTNet generates an initial coarse point cloud with both global geometry features and substructure geometry features. Guided by these semantic-geometry representations, SA-GFRTNet progressively refines the coarse output, effectively leveraging both global and substructure geometric priors to produce high-fidelity and geometrically consistent reconstructions. We further construct \textbf{HeartCompv1}, the first publicly available large-scale dataset with 17,000 high-resolution 3D multi-class cardiac meshes and point-clouds, to establish a general benchmark for this emerging research direction. Extensive cross-domain experiments on HeartCompv1 and UK Biobank demonstrate that HeartFormer achieves robust, accurate, and generalizable performance, consistently surpassing state-of-the-art (SOTA) methods. Code and dataset will be released upon acceptance at: https://github.com/10Darren/HeartFormer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。