arXiv:2505.08604cs.CV2025-05

用多出口注意力图和特征掩码,无监督识别医学影像中的异常数据。

Unsupervised Out-of-Distribution Detection in Medical Imaging Using Multi-Exit Class Activation Maps and Feature Masking

  • 通过反向注意力图遮蔽图像,捕捉不同分布下的特征变化差异。
  • 在多个医学数据集上表现优于现有方法,尤其在头部CT和新冠影像上提升显著。
  • 适合需要可解释性与高可靠性的临床医学深度学习应用。

无监督异常检测对保障医学影像中深度学习模型的可靠性至关重要。本文观察到:正常分布(ID)数据的类别激活图(CAMs)通常聚焦于与预测高度相关的区域,而异常分布(OOD)数据则缺乏此类集中激活。通过使用反向CAM遮蔽输入图像,正常数据的特征表示变化更显著,从而提供有效区分依据。为此,我们提出新型无监督框架MECAM,结合多出口CAM与特征掩码技术。该方法利用多尺度、多深度的网络输出生成融合的CAM,同时捕获全局与局部特征,增强检测鲁棒性。我们在ISIC19、PathMNIST等多个正常数据集上评估,并在RSNA Pneumonia、COVID-19、HeadCT等医学异常数据集及自然图像数据集iSUN上测试性能。与当前最优方法对比验证了其有效性。结果表明,多出口结构与特征掩码在医学影像无监督异常检测中具有巨大潜力,有助于推动临床实践中更可靠、可解释的模型发展。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models in medical imaging applications. This work is motivated by the observation that class activation maps (CAMs) for in-distribution (ID) data typically emphasize regions that are highly relevant to the model's predictions, whereas OOD data often lacks such focused activations. By masking input images with inverted CAMs, the feature representations of ID data undergo more substantial changes compared to those of OOD data, offering a robust criterion for differentiation. In this paper, we introduce a novel unsupervised OOD detection framework, Multi-Exit Class Activation Map (MECAM), which leverages multi-exit CAMs and feature masking. By utilizing mult-exit networks that combine CAMs from varying resolutions and depths, our method captures both global and local feature representations, thereby enhancing the robustness of OOD detection. We evaluate MECAM on multiple ID datasets, including ISIC19 and PathMNIST, and test its performance against three medical OOD datasets, RSNA Pneumonia, COVID-19, and HeadCT, and one natural image OOD dataset, iSUN. Comprehensive comparisons with state-of-the-art OOD detection methods validate the effectiveness of our approach. Our findings emphasize the potential of multi-exit networks and feature masking for advancing unsupervised OOD detection in medical imaging, paving the way for more reliable and interpretable models in clinical practice.

医学影像异常检测无监督学习可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。