arXiv:2409.20287eess.IVcs.CV2024-09中稿 · publication at the…被引 7

将分类模型解释方法迁移到医学图像分割,提升可解释性

Leveraging CAM Algorithms for Explaining Medical Semantic Segmentation

  • 将分类用的高分辨率CAM迁移至分割任务,改进原有方法
  • 在医学图像分割中显著增强关键区域定位准确性
  • 适合关注AI决策过程的医疗影像研究者

卷积神经网络(CNN)在图像分割任务中表现优异,但其决策过程仍不透明。可解释人工智能(xAI)致力于揭示这种黑箱行为。目前已有多种类激活图(CAM)用于分类任务的解释,但针对分割任务仅存在一种现有算法。本文提出将分类领域成熟的高分辨率CAM方法迁移至分割任务,构建新的Seg-HiRes-Grad CAM,该方法在分割型Seg-Grad CAM基础上融合分类型HiRes CAM优势。通过适配最新分类方法,本方法显著提升分割任务中显著像素的定位能力与结果一致性,在医学图像分割中有效缓解了原有可解释性不足的问题。

原文摘要 · Abstract (English)

Convolutional neural networks (CNNs) achieve prevailing results in segmentation tasks nowadays and represent the state-of-the-art for image-based analysis. However, the understanding of the accurate decision-making process of a CNN is rather unknown. The research area of explainable artificial intelligence (xAI) primarily revolves around understanding and interpreting this black-box behavior. One way of interpreting a CNN is the use of class activation maps (CAMs) that represent heatmaps to indicate the importance of image areas for the prediction of the CNN. For classification tasks, a variety of CAM algorithms exist. But for segmentation tasks, only one CAM algorithm for the interpretation of the output of a CNN exist. We propose a transfer between existing classification- and segmentation-based methods for more detailed, explainable, and consistent results which show salient pixels in semantic segmentation tasks. The resulting Seg-HiRes-Grad CAM is an extension of the segmentation-based Seg-Grad CAM with the transfer to the classification-based HiRes CAM. Our method improves the previously-mentioned existing segmentation-based method by adjusting it to recently published classification-based methods. Especially for medical image segmentation, this transfer solves existing explainability disadvantages.

医学图像可解释AI分割模型CAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。