用线性复杂度模型替代注意力机制,提升病理切片分类效率与精度
EfficientMIL: Efficient Linear-Complexity MIL Method for WSI Classification
- 设计自适应选块模块APS,结合GRU/LSTM/SSM实现线性计算复杂度
- 在TCGA-Lung和CAMELYON16数据集上分别达0.976和0.990的AUC,超越现有SOTA
- 适合需要高效处理海量病理图像的医疗AI研究者与临床部署场景
全切片图像(WSI)分类是计算病理学的核心挑战,多实例学习(MIL)已成为主流范式。当前最先进(SOTA)的MIL方法依赖注意力机制,虽性能优异,但因处理数十万张图像块时存在二次复杂度,计算开销巨大。为此,我们提出EfficientMIL,一种新型线性复杂度的MIL方法,其核心为自适应选块模块(APS),将基于Transformer的MIL方法中的二次复杂度自注意力机制替换为高效的序列模型,包括基于RNN的GRU、LSTM及状态空间模型(SSM)Mamba。EfficientMIL在多个组织病理学数据集上实现显著计算效率提升,并优于其他MIL方法。在TCGA-Lung数据集上,EfficientMIL-Mamba达到0.976 AUC与0.933准确率;在CAMELYON16数据集上,EfficientMIL-GRU达到0.990 AUC与0.975准确率,均超越此前最先进方法。大量实验表明,APS在图像块选择上也优于传统策略。
原文摘要 · Abstract (English)
Whole slide images (WSIs) classification represents a fundamental challenge in computational pathology, where multiple instance learning (MIL) has emerged as the dominant paradigm. Current state-of-the-art (SOTA) MIL methods rely on attention mechanisms, achieving good performance but requiring substantial computational resources due to quadratic complexity when processing hundreds of thousands of patches. To address this computational bottleneck, we introduce EfficientMIL, a novel linear-complexity MIL approach for WSIs classification with the patches selection module Adaptive Patch Selector (APS) that we designed, replacing the quadratic-complexity self-attention mechanisms in Transformer-based MIL methods with efficient sequence models including RNN-based GRU, LSTM, and State Space Model (SSM) Mamba. EfficientMIL achieves significant computational efficiency improvements while outperforming other MIL methods across multiple histopathology datasets. On TCGA-Lung dataset, EfficientMIL-Mamba achieved AUC of 0.976 and accuracy of 0.933, while on CAMELYON16 dataset, EfficientMIL-GRU achieved AUC of 0.990 and accuracy of 0.975, surpassing previous state-of-the-art methods. Extensive experiments demonstrate that APS is also more effective for patches selection than conventional selection strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。