新框架RBACA融合持续与主动学习,提升医学影像模型适应新场景能力。
Continual Deep Active Learning for Medical Imaging: Replay-Base Architecture for Context Adaptation
- 基于图像特征变化自动识别,用回放机制持续学习多场景数据
- 在心脏影像分割与诊断中,相比基线和先进方法性能更优
- 适合标注成本高、需长期更新的医学影像分析任务
深度学习在医学影像分析中面临适应新场景和泛化能力不足的问题,且常缺乏足够标注数据。持续学习(CL)通过从数据流中终身学习,缓解知识遗忘;主动学习(AL)则减少标注需求。本文提出联合持续与主动学习的新型框架RBACA:基于图像特征变化自动识别,采用回放机制持续学习多样场景,并通过主动学习选择最具信息量的样本进行标注。引入新评估指标IL-Score,可同时衡量迁移能力、遗忘程度和最终性能。在心脏影像分割与诊断任务中,RBACA在领域增量和类别增量学习下均优于无CAL的基线及当前最优方法,且在不同内存与标注预算下表现稳定。代码已开源。
原文摘要 · Abstract (English)
Deep Learning for medical imaging faces challenges in adapting and generalizing to new contexts. Additionally, it often lacks sufficient labeled data for specific tasks requiring significant annotation effort. Continual Learning (CL) tackles adaptability and generalizability by enabling lifelong learning from a data stream while mitigating forgetting of previously learned knowledge. Active Learning (AL) reduces the number of required annotations for effective training. This work explores both approaches (CAL) to develop a novel framework for robust medical image analysis. Based on the automatic recognition of shifts in image characteristics, Replay-Base Architecture for Context Adaptation (RBACA) employs a CL rehearsal method to continually learn from diverse contexts, and an AL component to select the most informative instances for annotation. A novel approach to evaluate CAL methods is established using a defined metric denominated IL-Score, which allows for the simultaneous assessment of transfer learning, forgetting, and final model performance. We show that RBACA works in domain and class-incremental learning scenarios, by assessing its IL-Score on the segmentation and diagnosis of cardiac images. The results show that RBACA outperforms a baseline framework without CAL, and a state-of-the-art CAL method across various memory sizes and annotation budgets. Our code is available in https://github.com/RuiDaniel/RBACA .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。