用可变形几何模板直接生成冠脉CT的表面网格,少数据也能准。
World of Forms: Deformable Geometric Templates for One-Shot Surface Meshing in Coronary CT Angiography
- 基于先验几何模板,通过可变形图网络直接生成3D网格
- 一-shot下分割性能超越nnUNet,网格质量媲美甚至优于体素后处理
- 适合低数据场景,支持灵活网格结构,避免拓扑错误
基于深度学习的医学图像分割与表面网格生成通常采用图像→分割→网格的流水线,需大量训练数据且较少利用几何先验,易导致拓扑不一致和低数据环境下性能下降。为此,我们提出一种数据高效的端到端3D解剖结构表面网格生成方法,利用多分辨率图神经网络对先验几何模板进行形变以匹配目标边界。该方法可适配不同表面目标,并引入新型3D球面数据掩码自编码器预训练策略。在心脏包膜、左心室腔及心肌的一次性(one-shot)分割任务中,该方法表现优于nnUNet;在多平面重建图像上的管腔分割中也优于现有方法。结果表明,网格质量与体素掩码经Marching Cubes后处理相当或更优,且保持网格三角化先验的灵活性,为更精确、拓扑一致的3D医学对象表面网格生成开辟了新路径。
原文摘要 · Abstract (English)
Deep learning-based medical image segmentation and surface mesh generation typically involve a sequential pipeline from image to segmentation to meshes, often requiring large training datasets while making limited use of prior geometric knowledge. This may lead to topological inconsistencies and suboptimal performance in low-data regimes. To address these challenges, we propose a data-efficient deep learning method for direct 3D anatomical object surface meshing using geometric priors. Our approach employs a multi-resolution graph neural network that operates on a prior geometric template which is deformed to fit object boundaries of interest. We show how different templates may be used for the different surface meshing targets, and introduce a novel masked autoencoder pretraining strategy for 3D spherical data. The proposed method outperforms nnUNet in a one-shot setting for segmentation of the pericardium, left ventricle (LV) cavity and the LV myocardium. Similarly, the method outperforms other lumen segmentation operating on multi-planar reformatted images. Results further indicate that mesh quality is on par with or improves upon marching cubes post-processing of voxel mask predictions, while remaining flexible in the choice of mesh triangulation prior, thus paving the way for more accurate and topologically consistent 3D medical object surface meshing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。