用自动掩码训练3D医学图像模型,无需标注也能学出通用表征。
Learning Generalizable 3D Medical Image Representations from Mask-Guided Self-Supervision
- 以无类别掩码为预训练任务,学习结构化语义信息。
- 小样本下仅用20%-40%标注数据,分割性能超自监督基线20+点Dice。
- 冻结编码器可识别未见病灶,媲美全监督训练效果。
基础模型通过大规模无标签数据学习通用表征,已重塑视觉与语言领域,但3D医学影像仍缺乏类似方法。现有自监督方法依赖低层重建或对比目标,难以捕捉对医学图像分析至关重要的解剖语义,限制了下游任务的迁移能力。我们提出MASS(MAsk-guided Self-Supervised learning),将上下文分割作为预训练任务,以学习通用医学图像表征。MASS的核心洞察是:自动生成的无类别掩码能提供足够的结构化监督,从而学习语义丰富的表示。通过在数千个涵盖解剖结构和病理发现的掩码提案上训练,MASS学会整合外观、形状、空间上下文及解剖关系等特征来定义医学结构。我们在多种数据条件下验证有效性:从单个数据集的小规模预训练(20-200例扫描)到5000例多模态CT、MRI和PET体积的大规模预训练,全程无需标注。MASS表现出:(i)对新结构的少样本分割能力;(ii)仅需20%-40%标注数据即可达到全监督水平,且在低数据场景下比自监督基线高出20+的Dice分数;(iii)冻结编码器在未见病灶分类任务中表现媲美使用数千样本的全监督训练。掩码引导的自监督预训练捕获了广泛泛化的知识,为无需专家标注的3D医学影像基础模型开辟道路。代码已开源:https://github.com/Stanford-AIMI/MASS。
原文摘要 · Abstract (English)
Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level reconstruction or contrastive objectives that fail to capture the anatomical semantics critical for medical image analysis, limiting transfer to downstream tasks. We present MASS (MAsk-guided Self-Supervised learning), which treats in-context segmentation as the pretext task for learning general-purpose medical imaging representations. MASS's key insight is that automatically generated class-agnostic masks provide sufficient structural supervision for learning semantically rich representations. By training on thousands of diverse mask proposals spanning anatomical structures and pathological findings, MASS learns what semantically defines medical structures: the holistic combination of appearance, shape, spatial context, and anatomical relationships. We demonstrate effectiveness across data regimes: from small-scale pretraining on individual datasets (20-200 scans) to large-scale multi-modal pretraining on 5K CT, MRI, and PET volumes, all without annotations. MASS demonstrates: (i) few-shot segmentation on novel structures, (ii) matching full supervision with only 20-40\% labeled data while outperforming self-supervised baselines by over 20 in Dice score in low-data regimes, and (iii) frozen-encoder classification on unseen pathologies that matches full supervised training with thousands of samples. Mask-guided self-supervised pretraining captures broadly generalizable knowledge, opening a path toward 3D medical imaging foundation models without expert annotations. Code is available: https://github.com/Stanford-AIMI/MASS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。