arXiv:2507.02395cs.CV2025-07ICCV被引 3

提出新框架,让病理切片模型持续学习且不遗忘,定位更准。

Continual Multiple Instance Learning with Enhanced Localization for Histopathological Whole Slide Image Analysis

  • 用分组双注意力机制高效编码病理块,提升特征表达。
  • 通过袋原型伪标签,实现可靠实例级标注,提升定位精度。
  • 采用正交加权低秩适配,有效缓解持续学习中的遗忘问题。

多实例学习(MIL)通过袋级别弱标签显著降低了大规模病理全切片图像(WSI)的标注成本。然而,其在持续任务中适应性强且遗忘少的能力尚未被充分探索,尤其是在实例分类与定位方面。已有研究虽在自然图像上开展弱增量语义分割的持续定位,但依赖预训练模型对数百个小型块(如 $16 \times 16$)间的全局关系建模,该方法难以适用于MIL定位任务——因存在约 $10^5$ 个大型块(如 $256 \times 256$),且缺乏癌症细胞等全局结构关系。为此,我们提出持续多实例学习增强定位框架(CoMEL),包含:(1) 分组双注意力变换器(GDAT)用于高效实例编码;(2) 袋原型伪标签(BPPL)实现可靠的实例伪标注;(3) 正交加权低秩适配(OWLoRA)以最小化袋级与实例级分类的遗忘。在三个公开的WSI数据集上的大量实验表明,CoMEL性能优越,在持续MIL设置下,袋级准确率最高提升 $11.00\%$,定位准确率最高提升 $23.4\%$。

原文摘要 · Abstract (English)

Multiple instance learning (MIL) significantly reduced annotation costs via bag-level weak labels for large-scale images, such as histopathological whole slide images (WSIs). However, its adaptability to continual tasks with minimal forgetting has been rarely explored, especially on instance classification for localization. Weakly incremental learning for semantic segmentation has been studied for continual localization, but it focused on natural images, leveraging global relationships among hundreds of small patches (e.g., $16 \times 16$) using pre-trained models. This approach seems infeasible for MIL localization due to enormous amounts ($\sim 10^5$) of large patches (e.g., $256 \times 256$) and no available global relationships such as cancer cells. To address these challenges, we propose Continual Multiple Instance Learning with Enhanced Localization (CoMEL), an MIL framework for both localization and adaptability with minimal forgetting. CoMEL consists of (1) Grouped Double Attention Transformer (GDAT) for efficient instance encoding, (2) Bag Prototypes-based Pseudo-Labeling (BPPL) for reliable instance pseudo-labeling, and (3) Orthogonal Weighted Low-Rank Adaptation (OWLoRA) to mitigate forgetting in both bag and instance classification. Extensive experiments on three public WSI datasets demonstrate superior performance of CoMEL, outperforming the prior arts by up to $11.00\%$ in bag-level accuracy and up to $23.4\%$ in localization accuracy under the continual MIL setup.

病理分析持续学习多实例学习定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。