arXiv:2504.17379eess.IVcs.CV2025-04被引 3

改进病理图像弱监督分类,让模型关注切片间空间关系

A Spatially-Aware Multiple Instance Learning Framework for Digital Pathology

  • 在ABMIL基础上加入切片间互动建模,保持高效计算
  • 乳腺癌和肺癌亚型分类中AUPRC提升7个百分点,一致性系数增5点
  • 适合需要高精度且计算资源受限的病理分析场景

多实例学习(MIL)是利用全切片图像(WSIs)进行弱监督病理分类的有力方法。然而,传统MIL方法如基于注意力的深度多实例学习(ABMIL)通常忽略对病理诊断至关重要的切片间空间交互。近期基于Transformer的MIL(TransMIL)虽引入了空间上下文和切片间关系,但其架构改变带来显著计算开销。本文提出在ABMIL框架中加入交互感知表示,构建全局ABMIL(GABMIL),显式建模切片依赖关系的同时保持计算效率。在两个公开乳腺癌和肺癌肿瘤亚型数据集上的实验表明,GABMIL相比ABMIL在AUPRC上最高提升7个百分点,在Kappa分数上提高5个百分点,且计算开销几乎无增加。结果证明在MIL框架中显式建模切片关系的重要性。代码已开源。

原文摘要 · Abstract (English)

Multiple instance learning (MIL) is a promising approach for weakly supervised classification in pathology using whole slide images (WSIs). However, conventional MIL methods such as Attention-Based Deep Multiple Instance Learning (ABMIL) typically disregard spatial interactions among patches that are crucial to pathological diagnosis. Recent advancements, such as Transformer based MIL (TransMIL), have incorporated spatial context and inter-patch relationships. However, it remains unclear whether explicitly modeling patch relationships yields similar performance gains in ABMIL, which relies solely on Multi-Layer Perceptrons (MLPs). In contrast, TransMIL employs Transformer-based layers, introducing a fundamental architectural shift at the cost of substantially increased computational complexity. In this work, we enhance the ABMIL framework by integrating interaction-aware representations to address this question. Our proposed model, Global ABMIL (GABMIL), explicitly captures inter-instance dependencies while preserving computational efficiency. Experimental results on two publicly available datasets for tumor subtyping in breast and lung cancers demonstrate that GABMIL achieves up to a 7 percentage point improvement in AUPRC and a 5 percentage point increase in the Kappa score over ABMIL, with minimal or no additional computational overhead. These findings underscore the importance of incorporating patch interactions within MIL frameworks. Our code is available at \href{https://github.com/tueimage/GABMIL}{\texttt{GABMIL}}.

病理图像多实例学习空间建模弱监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。