解决病理图像分析中模型遗忘问题,提升持续学习能力。
Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging
- 针对注意力MIL模型遗忘集中在注意力层的问题,提出新方法。
- 在多个病理图像数据集上准确率显著提升,内存占用更低。
- 适合需要长期更新的医学影像诊断系统使用。
医疗影像与深度学习的发展推动了全切片图像(WSI)分析的进步,多实例学习(MIL)在高效精准诊断方面展现出潜力。然而,传统MIL模型对动态数据集适应性差,依赖静态训练,无法在不重新训练的情况下融入新信息。将持续学习(CL)应用于MIL模型是潜在解决方案,但通常改进有限。本文分析了注意力MIL模型中的持续学习,发现模型遗忘主要集中在注意力层。基于此,提出两个组件:注意力知识蒸馏(AKD)和伪包记忆池(PMP)。AKD通过保留各学习阶段间注意力层知识缓解灾难性遗忘;PMP通过仅存储最具有信息量的图像块(即“伪包”),降低内存开销。实验表明,该方法在多种WSI数据集上显著提升准确率与内存效率,优于现有最先进的持续学习方法。本工作为大规模弱标注临床数据集中的持续学习奠定了基础,推动更灵活、更鲁棒的诊断模型发展。
原文摘要 · Abstract (English)
Advances in medical imaging and deep learning have propelled progress in whole slide image (WSI) analysis, with multiple instance learning (MIL) showing promise for efficient and accurate diagnostics. However, conventional MIL models often lack adaptability to evolving datasets, as they rely on static training that cannot incorporate new information without extensive retraining. Applying continual learning (CL) to MIL models is a possible solution, but often sees limited improvements. In this paper, we analyze CL in the context of attention MIL models and find that the model forgetting is mainly concentrated in the attention layers of the MIL model. Using the results of this analysis we propose two components for improving CL on MIL: Attention Knowledge Distillation (AKD) and the Pseudo-Bag Memory Pool (PMP). AKD mitigates catastrophic forgetting by focusing on retaining attention layer knowledge between learning sessions, while PMP reduces the memory footprint by selectively storing only the most informative patches, or ``pseudo-bags'' from WSIs. Experimental evaluations demonstrate that our method significantly improves both accuracy and memory efficiency on diverse WSI datasets, outperforming current state-of-the-art CL methods. This work provides a foundation for CL in large-scale, weakly annotated clinical datasets, paving the way for more adaptable and resilient diagnostic models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。