用自监督学习构建跨模态心脏分割基础模型,减少标注依赖。
Foundation Model for Whole-Heart Segmentation: Leveraging Student-Teacher Learning in Multi-Modal Medical Imaging
- 基于学生-教师框架的自监督预训练,融合多模态数据
- 在少量标注数据下仍保持高精度,支持CT/MRI通用分割
- 适合医疗影像领域研究者与临床部署团队使用
从CT和MRI扫描中进行全心脏分割对心血管疾病分析至关重要,但现有方法面临模态特异性偏差和大量标注数据的需求。为此,我们提出一种基于学生-教师架构的自监督学习(SSL)框架,构建全心脏分割基础模型。该模型在大规模未标注的CT与MRI数据上预训练,采用xLSTM骨干网络捕捉3D医学图像中的长程空间依赖性和复杂解剖结构。通过多模态预训练,模型具备强泛化能力,有效缓解模态差异,在不同临床场景中提升分割准确性。利用大规模未标注数据显著降低对人工标注的依赖,使模型在有限标注数据下仍表现稳健。我们进一步设计了基于xLSTM-UNet的下游分割架构,在少量标注的CT与MRI数据集上验证其有效性。结果表明,该模型具备良好的鲁棒性与可迁移性,为自动化全心脏分割提供了新路径。
原文摘要 · Abstract (English)
Whole-heart segmentation from CT and MRI scans is crucial for cardiovascular disease analysis, yet existing methods struggle with modality-specific biases and the need for extensive labeled datasets. To address these challenges, we propose a foundation model for whole-heart segmentation using a self-supervised learning (SSL) framework based on a student-teacher architecture. Our model is pretrained on a large, unlabeled dataset of CT and MRI scans, leveraging the xLSTM backbone to capture long-range spatial dependencies and complex anatomical structures in 3D medical images. By incorporating multi-modal pretraining, our approach ensures strong generalization across both CT and MRI modalities, mitigating modality-specific variations and improving segmentation accuracy in diverse clinical settings. The use of large-scale unlabeled data significantly reduces the dependency on manual annotations, enabling robust performance even with limited labeled data. We further introduce an xLSTM-UNet-based architecture for downstream whole-heart segmentation tasks, demonstrating its effectiveness on few-label CT and MRI datasets. Our results validate the robustness and adaptability of the proposed model, highlighting its potential for advancing automated whole-heart segmentation in medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。