arXiv:2607.12048cs.CVcs.AI2026-07

评估医学视觉问答中持续学习对不同任务的适应能力

An Empirical Analysis of Continual Learning for Heterogeneous Medical Visual Question Answering

论文配图:An Empirical Analysis of Continual Learning for Heterogeneous Medical Visual Question Answering
图 1 · 摘自论文原文
  • 对比多种持续学习方法在异构医疗任务中的表现
  • 发现现有方法在任务顺序变化时易产生严重遗忘
  • 揭示参数漂移规律,为模型稳定性提供新视角

将医学视觉问答(MedVQA)系统部署于真实临床场景,需模型在不遗忘旧知识的前提下适应新任务。持续学习(CL)为此提供了可行框架。尽管医疗视觉语言模型进展迅速,但其在异构MedVQA任务上的持续学习行为仍缺乏研究。本文系统评估了在多样化临床目标(包括分类、多标签分类、检测、细胞计数和报告生成)下持续学习的表现。具体分析:(1)现有CL方法缓解灾难性遗忘的能力;(2)任务顺序敏感性,即不同任务序列对性能保持与遗忘的影响;(3)低秩适配参数随新任务学习的演化过程,揭示不同CL方法下的权重漂移模式。结果表明,当涉及不同目标与标注形式的任务交错时,现有方法难以维持稳定与灵活的平衡。代码与完整实验设置将公开。

原文摘要 · Abstract (English)

Deploying medical visual question answering (MedVQA) systems in real-world clinical settings requires models that adapt to new clinical tasks without forgetting previously acquired knowledge. Continual learning (CL) provides a practical framework for this setting. Despite rapid progress in medical vision-language models, the behavior of CL methods when training these models across heterogeneous MedVQA tasks remains underexplored. This work presents a systematic evaluation of CL for MedVQA across diverse clinical objectives, including classification, multi-label classification, detection, cell counting, and report generation. Specifically, we explore (1) the ability of existing CL methods to mitigate catastrophic forgetting; (2) their sensitivity to task ordering, analyzing how different task sequences influence performance retention and forgetting; and (3) the evolution of low-rank adaptation parameters as new tasks are learned, revealing patterns of weight drift under different CL methods. Our findings suggest that existing CL methods struggle to maintain stability-plasticity balance when tasks with different objectives and supervision formats are interleaved. Code and full experimental setup will be publicly available.

持续学习医学视觉多任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。