用自监督学习提升儿童胸片分类模型的泛化能力。
Self-Supervised Learning for Building Robust Pediatric Chest X-ray Classification Models
- 结合迁移学习与自监督对比学习,增强肺部特征提取。
- 零样本测试下AUC提升达34.6%,少样本训练效果媲美全量数据。
- 适合缺乏标注数据的儿科医学影像场景,也可推广至乳腺癌检测。
深度学习在成人胸片诊断中已达到临床专家水平,但其在儿科应用受限于高质量标注数据稀缺,且不同医院间图像差异大、患者年龄跨度广(0-18岁)。为此,我们提出SCC方法,融合迁移学习与自监督对比学习,并引入无监督对比度增强技术。利用预训练成人胸片模型缓解儿科数据不足问题;对比学习聚焦肺部区域,降低图像变异影响,生成高质量嵌入表示。我们在一个儿科数据集上训练SCC,评估其在另外两个来源不同的儿科数据集上的表现。结果表明,零样本(out-of-distribution)测试下,SCC的AUC分别比常规迁移学习高出13.6%和34.6%;仅需1/10标注数据的少样本学习,即达到全量数据训练的迁移学习性能。为验证框架普适性,我们在三个基准乳腺癌数据集上测试:从自然图像预训练模型出发,微调一个乳腺数据集后,零样本迁移在另两个数据集上AUC分别领先3.6%和5.5%。
原文摘要 · Abstract (English)
Recent advancements in deep learning for Medical Artificial Intelligence have demonstrated that models can match the diagnostic performance of clinical experts in adult chest X-ray (CXR) interpretation. However, their application in the pediatric context remains limited due to the scarcity of large annotated pediatric image datasets. Additionally, significant challenges arise from the substantial variability in pediatric CXR images across different hospitals and the diverse age range of patients from 0 to 18 years. To address these challenges, we propose SCC, a novel approach that combines transfer learning with self-supervised contrastive learning, augmented by an unsupervised contrast enhancement technique. Transfer learning from a well-trained adult CXR model mitigates issues related to the scarcity of pediatric training data. Contrastive learning with contrast enhancement focuses on the lungs, reducing the impact of image variations and producing high-quality embeddings across diverse pediatric CXR images. We train SCC on one pediatric CXR dataset and evaluate its performance on two other pediatric datasets from different sources. Our results show that SCC's out-of-distribution (zero-shot) performance exceeds regular transfer learning in terms of AUC by 13.6% and 34.6% on the two test datasets. Moreover, with few-shot learning using 10 times fewer labeled images, SCC matches the performance of regular transfer learning trained on the entire labeled dataset. To test the generality of the framework, we verify its performance on three benchmark breast cancer datasets. Starting from a model trained on natural images and fine-tuned on one breast dataset, SCC outperforms the fully supervised learning baseline on the other two datasets in terms of AUC by 3.6% and 5.5% in zero-shot learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。