解决病理图像诊断中注意力不稳定的难题,提升模型可靠性
ASMIL: Attention-Stabilized Multiple Instance Learning for Whole Slide Imaging
- 用锚模型稳定注意力分布,防止训练震荡
- 改进注意力函数,避免注意力过度集中,提升泛化性
- 适合需要高可靠性的医学图像分析场景
基于注意力的多实例学习(MIL)已成为全切片图像(WSI)诊断的强大框架,通过注意力机制将实例级特征聚合为整体预测。然而我们发现这类方法存在新问题:注意力动态不稳定,跨训练周期注意力分布持续振荡而非收敛,导致性能下降。此不稳定性叠加已知的过拟合和注意力过度集中问题。为此,我们提出注意力稳定型多实例学习(ASMIL),一种统一新框架:使用锚模型稳定注意力,将锚模型中的softmax替换为归一化sigmoid以防止注意力过度集中,并引入标记随机丢弃缓解过拟合。大量实验表明,ASMIL相比现有最优方法最高提升6.49%的F1分数;将锚模型与归一化sigmoid集成到已有方法中,性能提升最高达10.73%。所有代码与数据公开于https://github.com/Linfeng-Ye/ASMIL。
原文摘要 · Abstract (English)
Attention-based multiple instance learning (MIL) has emerged as a powerful framework for whole slide image (WSI) diagnosis, leveraging attention to aggregate instance-level features into bag-level predictions. Despite this success, we find that such methods exhibit a new failure mode: unstable attention dynamics. Across four representative attention-based MIL methods and two public WSI datasets, we observe that attention distributions oscillate across epochs rather than converging to a consistent pattern, degrading performance. This instability adds to two previously reported challenges: overfitting and over-concentrated attention distribution. To simultaneously overcome these three limitations, we introduce attention-stabilized multiple instance learning (ASMIL), a novel unified framework. ASMIL uses an anchor model to stabilize attention, replaces softmax with a normalized sigmoid function in the anchor to prevent over-concentration, and applies token random dropping to mitigate overfitting. Extensive experiments demonstrate that ASMIL achieves up to a 6.49\% F1 score improvement over state-of-the-art methods. Moreover, integrating the anchor model and normalized sigmoid into existing attention-based MIL methods consistently boosts their performance, with F1 score gains up to 10.73\%. All code and data are publicly available at https://github.com/Linfeng-Ye/ASMIL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。