用自监督学习训练3D脑部CT基础模型,提升罕见病检测能力。
3D Foundation Model for Generalizable Disease Detection in Head Computed Tomography
- 基于36万张无标注3D脑CT自监督预训练,学习通用特征
- 在内外部数据集上显著优于从零训练和已有3D模型
- 适合医疗AI研究者与临床辅助诊断系统开发者
头颅计算机断层扫描(CT)是神经急症中广泛应用的影像技术,涵盖脑、颅骨及脑血管系统的病理评估。由于其成像快速、安全、成本低且普及率高,常作为首选检查手段。深度学习可助力多种疾病检测,但高质量标注数据稀缺,尤其对少见病种制约明显。为此,我们提出FM-CT:一种用于头颅CT的通用疾病检测基础模型,采用自监督学习进行预训练。该模型在包含361,663例非增强3D头颅CT的大型多样化数据集上无需人工标注即可训练,从而学习到鲁棒且通用的特征表示。我们采用自蒸馏判别与掩码图像建模两种自监督策略,并构建3D而非2D切片模型,以更充分地利用头颅CT的空间结构信息。通过内部及三个外部数据集(含分布内和分布外数据)验证下游分类性能,结果表明,该自监督基础模型在诊断任务上的表现显著优于从零训练的模型以及现有3D CT基础模型,尤其在标注数据稀缺场景下优势突出。本工作证实了自监督学习在医学影像中的有效性,为3D头颅CT分析树立了新基准,推动人工智能在头颅CT诊断中的广泛应用。
原文摘要 · Abstract (English)
Head computed tomography (CT) imaging is a widely-used imaging modality with multitudes of medical indications, particularly in assessing pathology of the brain, skull, and cerebrovascular system. It is commonly the first-line imaging in neurologic emergencies given its rapidity of image acquisition, safety, cost, and ubiquity. Deep learning models may facilitate detection of a wide range of diseases. However, the scarcity of high-quality labels and annotations, particularly among less common conditions, significantly hinders the development of powerful models. To address this challenge, we introduce FM-CT: a Foundation Model for Head CT for generalizable disease detection, trained using self-supervised learning. Our approach pre-trains a deep learning model on a large, diverse dataset of 361,663 non-contrast 3D head CT scans without the need for manual annotations, enabling the model to learn robust, generalizable features. To investigate the potential of self-supervised learning in head CT, we employed both discrimination with self-distillation and masked image modeling, and we construct our model in 3D rather than at the slice level (2D) to exploit the structure of head CT scans more comprehensively and efficiently. The model's downstream classification performance is evaluated using internal and three external datasets, encompassing both in-distribution (ID) and out-of-distribution (OOD) data. Our results demonstrate that the self-supervised foundation model significantly improves performance on downstream diagnostic tasks compared to models trained from scratch and previous 3D CT foundation models on scarce annotated datasets. This work highlights the effectiveness of self-supervised learning in medical imaging and sets a new benchmark for head CT image analysis in 3D, enabling broader use of artificial intelligence for head CT-based diagnosis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。