一个模型搞定心脏多模态影像分割,准确又省时。
Modality-AGnostic Image Cascade (MAGIC) for Multi-Modality Cardiac Substructure Segmentation
- 用复用的nnU-Net结构处理多种医学影像输入和重叠结构
- 在三种模态上平均分割精度达0.80以上,显著优于单模态模型
- 训练速度和参数量减少超70%,适合临床快速部署
心脏亚结构分割在治疗规划中日益重要,可降低放射性心脏病风险。深度学习虽能减轻勾画负担,但跨模态通用性和重叠结构分割能力不足。本文提出并验证了针对多模态心脏亚结构分割的模态无关图像级联(MAGIC)深度学习流程。MAGIC通过复制nnU-Net主干的编码解码分支,处理多模态输入与重叠标签。首次在包含心脏CT血管造影(CCTA)和磁共振(MR)的多模态全心分割(MMWHS)数据集上评估,涵盖临床模拟CT(Sim-CT)、低场MR-Linac及CCTA共20个心脏结构。使用151例半监督训练、15例验证、30例测试。对比14个单模态基线模型,评估指标为骰子相似系数(DSC)和双尾威尔科克斯符号秩检验(p<0.05)。CCTA和MR输入的平均MMWHS DSC分别为0.88(0.08)和0.87(0.04),显著优于单模态基线。20结构平均DSC为:Sim-CT 0.75(0.16),MR-Linac 0.68(0.21),CCTA 0.80(0.16)。同时实现训练时间与参数量分别>80%和>70%的减少。MAGIC提供高效轻量解决方案,在单一模型中完成多模态与重叠结构分割,不牺牲精度。
原文摘要 · Abstract (English)
Cardiac substructure delineation is emerging in treatment planning to minimize the risk of radiation-induced heart disease. Deep learning offers efficient methods to reduce contouring burden but currently lacks generalizability across different modalities and overlapping structures. This work introduces and validates a Modality-AGnostic Image Cascade (MAGIC) deep-learning pipeline for comprehensive and multi-modal cardiac substructure segmentation. MAGIC is implemented through replicated encoding and decoding branches of an nnU-Net backbone to handle multi-modality inputs and overlapping labels. First benchmarked on the multi-modality whole-heart segmentation (MMWHS) dataset including cardiac CT-angiography (CCTA) and MR modalities, twenty cardiac substructures (heart, chambers, great vessels (GVs), valves, coronary arteries (CAs), and conduction nodes) from clinical simulation CT (Sim-CT), low-field MR-Linac, and cardiac CT-angiography (CCTA) modalities were delineated to train semi-supervised (n=151), validate (n=15), and test (n=30) MAGIC. For comparison, fourteen single-modality comparison models (two MMWHS modalities and four subgroups across three clinical modalities) were trained. Methods were evaluated for efficiency and against reference contours through the Dice similarity coefficient (DSC) and two-tailed Wilcoxon Signed-Rank test (p<0.05). Average MMWHS DSC scores across CCTA and MR inputs were 0.88(0.08) and 0.87(0.04) respectively with significant improvement over unimodal baselines. Average 20-structure DSC scores were 0.75(0.16) for Sim-CT, 0.68(0.21) for MR-Linac, and 0.80(0.16) for CCTA. Furthermore, >80% and >70% reductions in training time and parameters were achieved, respectively. MAGIC offers an efficient, lightweight solution capable of segmenting multiple image modalities and overlapping structures in a single model without compromising segmentation accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。