让医学基础模型持续学习,跨模态任务不遗忘。
UNICON: UNIfied CONtinual Learning for Medical Foundational Models
- 统一框架实现模型对不同医学任务的连续适应。
- 在新任务上性能提升,加入PET后Dice分数提高5%。
- 适合需要长期更新、多任务协同的医疗AI系统开发者。
基础模型通过大规模数据训练捕捉领域通用规律,但在医学影像中,因数据稀缺,为每个领域、模态或任务进行预训练困难重重。持续学习通过顺序微调模型,使其在无需每阶段大量数据的情况下融合新知识。本文提出针对医学基础模型的统一持续学习框架UNICON,使模型能无缝适应多种领域、任务和模态。与传统孤立处理方式不同,UNICON提供一个可永久扩展的统一架构。通过精心整合,我们证明基础模型可动态扩展至不同成像模态、解剖区域和临床目标,且无灾难性遗忘或任务干扰。实验验证:将初始用于分类的胸部CT基础模型,依次适配预后和分割任务,性能均提升。进一步持续引入PET扫描,相比基线模型,Dice分数提升5%。结果表明,基础模型不限于初始训练范围,可不断演化,为医学影像通用人工智能铺路。
原文摘要 · Abstract (English)
Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers a solution by fine-tuning a model sequentially on different domains or tasks, enabling it to integrate new knowledge without requiring large datasets for each training phase. In this paper, we propose UNIfied CONtinual Learning for Medical Foundational Models (UNICON), a framework that enables the seamless adaptation of foundation models to diverse domains, tasks, and modalities. Unlike conventional adaptation methods that treat these changes in isolation, UNICON provides a unified, perpetually expandable framework. Through careful integration, we show that foundation models can dynamically expand across imaging modalities, anatomical regions, and clinical objectives without catastrophic forgetting or task interference. Empirically, we validate our approach by adapting a chest CT foundation model initially trained for classification to a prognosis and segmentation task. Our results show improved performance across both additional tasks. Furthermore, we continually incorporated PET scans and achieved a 5\% improvement in Dice score compared to respective baselines. These findings establish that foundation models are not inherently constrained to their initial training scope but can evolve, paving the way toward generalist AI models for medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。