arXiv:2509.11526cs.CV2025-09IJCV被引 6

针对病理图像难例挖掘不足问题,提出新型多实例学习框架。

Multiple Instance Learning Framework with Masked Hard Instance Mining for Gigapixel Histopathology Image Analysis

  • 用一致性约束的孪生结构挖掘难样本
  • 在12个基准上超越最新方法,提升诊断准确率
  • 适合医学图像分析与难例学习研究者

将病理图像数字化为千兆像素全切片图像(WSIs)为计算病理学(CPath)开辟了新路径。由于阳性组织仅占极小比例,现有多实例学习(MIL)方法多依赖注意力机制识别显著实例,但易偏向易分类样本而忽略难例。研究表明难例对精确建模判别边界至关重要。本文提出基于掩码难例挖掘的MIL框架(MHIM-MIL),采用孪生结构结合一致性约束探索难例。通过类别感知实例概率,利用动量教师模型掩蔽显著实例,隐式挖掘难例用于学生模型训练。为获取多样且非冗余的难例,引入大规模随机掩码,并使用全局回收网络避免关键特征丢失。同时,学生模型通过指数移动平均更新教师,持续发现新难例并稳定优化过程。在癌症诊断、分型及生存分析等任务的12个基准上,实验表明MHIM-MIL在性能和效率上均优于当前最优方法。代码已开源:https://github.com/DearCaat/MHIM-MIL。

原文摘要 · Abstract (English)

Digitizing pathological images into gigapixel Whole Slide Images (WSIs) has opened new avenues for Computational Pathology (CPath). As positive tissue comprises only a small fraction of gigapixel WSIs, existing Multiple Instance Learning (MIL) methods typically focus on identifying salient instances via attention mechanisms. However, this leads to a bias towards easy-to-classify instances while neglecting challenging ones. Recent studies have shown that hard examples are crucial for accurately modeling discriminative boundaries. Applying such an idea at the instance level, we elaborate a novel MIL framework with masked hard instance mining (MHIM-MIL), which utilizes a Siamese structure with a consistency constraint to explore the hard instances. Using a class-aware instance probability, MHIM-MIL employs a momentum teacher to mask salient instances and implicitly mine hard instances for training the student model. To obtain diverse, non-redundant hard instances, we adopt large-scale random masking while utilizing a global recycle network to mitigate the risk of losing key features. Furthermore, the student updates the teacher using an exponential moving average, which identifies new hard instances for subsequent training iterations and stabilizes optimization. Experimental results on cancer diagnosis, subtyping, survival analysis tasks, and 12 benchmarks demonstrate that MHIM-MIL outperforms the latest methods in both performance and efficiency. The code is available at: https://github.com/DearCaat/MHIM-MIL.

医学图像多实例学习难例挖掘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。