arXiv:2605.20297cs.CVcs.LG2026-05中稿 · ICML

医学影像分割新框架,自动发现任务结构并避免遗忘。

MedCRP-CL: Continual Medical Image Segmentation via Bayesian Nonparametric Semantic Modality Discovery

论文配图:MedCRP-CL: Continual Medical Image Segmentation via Bayesian Nonparametric Semantic Modality Discovery
图 1 · 摘自论文原文
  • 用中文餐厅过程动态发现任务分组,无需预设类别数。
  • 在16个任务上达73.3%骰子分数,遗忘率仅4.1%。
  • 无需存储患者数据,适合医疗场景隐私保护需求。

医学图像分割在持续学习中面临核心挑战:数据来自异构来源且按序到达,但有效持续学习需识别哪些任务具有足够结构相似性以共享知识。现有方法或对所有任务施加统一约束,导致任务冲突时灾难性遗忘;或依赖预定义任务分组,无法应对未来任务多样性。本文提出MedCRP-CL,一种在线发现任务结构并基于结构进行持续学习的框架。利用中国餐馆过程(CRP),该方法在任务到来时从临床文本提示中动态推断任务分组,无需预设聚类数量或未来任务信息。所发现的分组称为语义模态,融合解剖区域与病理上下文,比物理成像模态更细粒度。基于此结构,模型维护针对语义模态的LoRA适配器,并通过模态内EWC正则化,实现不同任务组间参数隔离,同类任务内知识迁移。框架无需回放,仅存储聚合统计量而非原始数据。在四个成像模态上的16个医学分割任务实验表明,MedCRP-CL取得73.3%的骰子分数,遗忘率仅为4.1%,优于最佳基线8.0%,且参数量减少6倍。

原文摘要 · Abstract (English)

Medical image segmentation faces a fundamental challenge in continual learning: data arrives sequentially from heterogeneous sources, yet effective continual learning requires discovering which tasks share sufficient structure to benefit from joint learning. Existing methods either apply uniform constraints across all tasks, causing catastrophic forgetting when tasks conflict, or require predefined task groupings that cannot anticipate future task diversity. We introduce MedCRP-CL, a framework that performs online task structure discovery and structure-aware continual learning. Leveraging the Chinese Restaurant Process (CRP), our method dynamically infers task groupings from clinical text prompts as tasks arrive, without requiring predefined cluster counts or access to future tasks. We term these discovered groupings semantic modalities, as they capture finer-grained structure than physical imaging modalities by integrating anatomical region and pathological context. Guided by this discovered structure, we maintain semantic modality-specific LoRA adapters regularized by intra-modality EWC, ensuring parameter isolation across dissimilar task groups while facilitating knowledge transfer within similar ones. The framework is also replay-free, storing only aggregate statistics rather than raw patient data. Experiments on 16 medical segmentation tasks across four imaging modalities demonstrate that MedCRP-CL achieves 73.3% Dice score with only 4.1% forgetting, outperforming the best baseline by 8.0% while requiring 6$\times$ fewer parameters. Code is available at https://github.com/zygao930/MedCRP-CL.

医学影像持续学习贝叶斯非参数语义模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。