arXiv:2509.06096cs.CV2025-09被引 1

提出顺序微调框架,让医学图像分割模型持续学习新任务且不遗忘旧知识。

MedSeqFT: Sequential Fine-tuning Foundation Models for 3D Medical Image Segmentation

  • 按任务顺序微调,用相似性选择关键数据保留通用能力
  • 平均Dice提升3.0%,在未见任务上肿瘤分割效果显著增强
  • 适合需要持续更新的临床场景,尤其擅长增量学习

基础模型在医学图像分析中展现出巨大潜力,尤其在下游任务逐个出现的分割任务中。现有微调策略受限:并行微调隔离任务,无法共享知识;多任务微调需同时访问所有数据集,难以支持增量任务。为此,我们提出MedSeqFT,一种渐进式微调框架,能逐步适应新任务并优化表征能力。核心包含:(1) 最大数据相似性(MDS)选择,识别最能代表预训练分布的样本以保留通用知识;(2) 知识与泛化保持微调(K&G RFT),基于LoRA的知识蒸馏方案,在任务特化与旧知识保留间取得平衡。在涵盖十项3D分割任务的两个多任务数据集上实验表明,MedSeqFT持续优于现有最优微调方法,平均Dice提升达3.0%。对两个未见任务(COVID-19-20和Kidney)的评估显示,其显著提升迁移能力,尤其在肿瘤分割上表现突出。损失曲面与参数变化的可视化分析进一步验证了其鲁棒性。结果确立了顺序微调作为可保留知识的有效范式,适用于不断演进的临床任务。代码将公开。

原文摘要 · Abstract (English)

Foundation models have become a promising paradigm for advancing medical image analysis, particularly for segmentation tasks where downstream applications often emerge sequentially. Existing fine-tuning strategies, however, remain limited: parallel fine-tuning isolates tasks and fails to exploit shared knowledge, while multi-task fine-tuning requires simultaneous access to all datasets and struggles with incremental task integration. To address these challenges, we propose MedSeqFT, a sequential fine-tuning framework that progressively adapts pre-trained models to new tasks while refining their representational capacity. MedSeqFT introduces two core components: (1) Maximum Data Similarity (MDS) selection, which identifies downstream samples most representative of the original pre-training distribution to preserve general knowledge, and (2) Knowledge and Generalization Retention Fine-Tuning (K&G RFT), a LoRA-based knowledge distillation scheme that balances task-specific adaptation with the retention of pre-trained knowledge. Extensive experiments on two multi-task datasets covering ten 3D segmentation tasks demonstrate that MedSeqFT consistently outperforms state-of-the-art fine-tuning strategies, yielding substantial performance gains (e.g., an average Dice improvement of 3.0%). Furthermore, evaluations on two unseen tasks (COVID-19-20 and Kidney) verify that MedSeqFT enhances transferability, particularly for tumor segmentation. Visual analyses of loss landscapes and parameter variations further highlight the robustness of MedSeqFT. These results establish sequential fine-tuning as an effective, knowledge-retentive paradigm for adapting foundation models to evolving clinical tasks. Code will be released.

医学图像序列微调分割知识保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。