一个模型搞定胸部X光的分类、定位与分割,用多数据协同训练提升诊断能力。
Foundation X: Integrating Classification, Localization, and Segmentation through Lock-Release Pretraining Strategy for Chest X-ray Analysis
- 采用锁-释放预训练策略,循环学习多源标注数据。
- 在11个数据集上训练,实现跨任务、跨数据集性能提升。
- 适合医疗影像研究者与临床辅助系统开发者使用。
构建稳健且通用的深度学习模型对提升医学影像诊断准确性和指导临床干预至关重要,但需要大量标注数据。深度学习的发展催生了多个具有专家级标注的医学数据集。整合这些数据集可最大化数据利用率,缓解标注不足问题。然而,分类、定位和分割等任务间标注的异质性给学习带来挑战。为此,我们提出Foundation X,一个端到端框架,利用多个公开数据集中的多样专家标注,训练一个能完成分类、定位和分割的通用模型。为应对标注与任务异质性,我们设计了锁-释放预训练策略,结合师生学习范式,确保模型保留各任务的通用知识,同时避免对单一任务过拟合。通过在11个胸部X光数据集上训练,实验表明Foundation X通过广泛利用标注信息,在跨数据集和跨任务学习中表现优异,并显著提升器官定位与分割性能。所有代码与预训练模型已公开于https://github.com/jlianglab/Foundation_X。
原文摘要 · Abstract (English)
Developing robust and versatile deep-learning models is essential for enhancing diagnostic accuracy and guiding clinical interventions in medical imaging, but it requires a large amount of annotated data. The advancement of deep learning has facilitated the creation of numerous medical datasets with diverse expert-level annotations. Aggregating these datasets can maximize data utilization and address the inadequacy of labeled data. However, the heterogeneity of expert-level annotations across tasks such as classification, localization, and segmentation presents a significant challenge for learning from these datasets. To this end, we introduce nFoundation X, an end-to-end framework that utilizes diverse expert-level annotations from numerous public datasets to train a foundation model capable of multiple tasks including classification, localization, and segmentation. To address the challenges of annotation and task heterogeneity, we propose a Lock-Release pretraining strategy to enhance the cyclic learning from multiple datasets, combined with the student-teacher learning paradigm, ensuring the model retains general knowledge for all tasks while preventing overfitting to any single task. To demonstrate the effectiveness of Foundation X, we trained a model using 11 chest X-ray datasets, covering annotations for classification, localization, and segmentation tasks. Our experimental results show that Foundation X achieves notable performance gains through extensive annotation utilization, excels in cross-dataset and cross-task learning, and further enhances performance in organ localization and segmentation tasks. All code and pretrained models are publicly accessible at https://github.com/jlianglab/Foundation_X.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。