提出概率化注意力机制,提升医学图像分类的准确性和可解释性。
Probabilistic smooth attention for deep multiple instance learning in medical imaging
- 用概率分布代替固定注意力值,同时建模局部与全局依赖关系。
- 在三个医学数据集上超越11个基线模型,性能达到最优。
- 生成的不确定性图能定位病变区域,适合临床辅助诊断场景。
多重实例学习(MIL)在医疗影像分类中备受关注,因其仅需整体标签即可训练,适用于标注数据稀缺的场景。该方法将医学图像视为实例集合(如全切片图像中的子块或CT扫描中的切片),通过注意力机制聚合实例特征以预测整体类别。现有深度MIL方法虽能捕捉相邻实例间的局部关联及远距离依赖,但通常采用确定性注意力,忽略了单个实例贡献的不确定性。本文提出一种新型概率框架,对注意力值估计概率分布,并兼顾全局与局部交互。在包含十一项先进基线和三个医学数据集的综合评估中,本方法在多个指标上均取得最佳表现。此外,概率化的注意力机制生成的不确定性图可解释疾病定位,提升临床可读性。
原文摘要 · Abstract (English)
The Multiple Instance Learning (MIL) paradigm is attracting plenty of attention in medical imaging classification, where labeled data is scarce. MIL methods cast medical images as bags of instances (e.g. patches in whole slide images, or slices in CT scans), and only bag labels are required for training. Deep MIL approaches have obtained promising results by aggregating instance-level representations via an attention mechanism to compute the bag-level prediction. These methods typically capture both local interactions among adjacent instances and global, long-range dependencies through various mechanisms. However, they treat attention values deterministically, potentially overlooking uncertainty in the contribution of individual instances. In this work we propose a novel probabilistic framework that estimates a probability distribution over the attention values, and accounts for both global and local interactions. In a comprehensive evaluation involving {\color{review} eleven} state-of-the-art baselines and three medical datasets, we show that our approach achieves top predictive performance in different metrics. Moreover, the probabilistic treatment of the attention provides uncertainty maps that are interpretable in terms of illness localization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。