通过概率空间注意力提升病理切片分类,更准且更快。
PSA-MIL: A Probabilistic Spatial Attention-Based Multiple Instance Learning for Whole Slide Image Classification
- 用可学习的距离衰减先验建模切片空间关系,动态捕捉组织结构。
- 在多个数据集上超越现有方法,计算复杂度降低约50%。
- 适合医疗影像分析、病理图像分类研究者参考。
全切片图像(WSI)是医学诊断中广泛应用的高分辨率数字扫描图。传统多实例学习(MIL)将切片划分为小块作为实例,但现有基于注意力的方法常忽略这些小块间的空间关联,可能遗漏对诊断至关重要的复杂组织结构。为此,我们提出概率空间注意力多实例学习(PSA-MIL),在自注意力的概率解释框架下引入可学习的距离衰减先验,使空间关系在训练中动态推断,无需预设假设。同时,设计空间后验剪枝策略,有效降低自注意力的二次复杂度。为进一步增强空间建模,引入多样性损失,促使各注意力头学习不同空间表征。实验表明,PSA-MIL在多种基准上达到最优性能,同时显著降低计算开销。
原文摘要 · Abstract (English)
Whole Slide Images (WSIs) are high-resolution digital scans widely used in medical diagnostics. WSI classification is typically approached using Multiple Instance Learning (MIL), where the slide is partitioned into tiles treated as interconnected instances. While attention-based MIL methods aim to identify the most informative tiles, they often fail to fully exploit the spatial relationships among them, potentially overlooking intricate tissue structures crucial for accurate diagnosis. To address this limitation, we propose Probabilistic Spatial Attention MIL (PSA-MIL), a novel attention-based MIL framework that integrates spatial context into the attention mechanism through learnable distance-decayed priors, formulated within a probabilistic interpretation of self-attention as a posterior distribution. This formulation enables a dynamic inference of spatial relationships during training, eliminating the need for predefined assumptions often imposed by previous approaches. Additionally, we suggest a spatial pruning strategy for the posterior, effectively reducing self-attention's quadratic complexity. To further enhance spatial modeling, we introduce a diversity loss that encourages variation among attention heads, ensuring each captures distinct spatial representations. Together, PSA-MIL enables a more data-driven and adaptive integration of spatial context, moving beyond predefined constraints. We achieve state-of-the-art performance across both contextual and non-contextual baselines, while significantly reducing computational costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。