arXiv:2412.01354cs.CVcs.AI2024-12被引 6

融合多层特征,让卷积网络决策更可解释

Integrative CAM: Adaptive Layer Fusion for Comprehensive Interpretation of CNNs

  • 自适应融合所有层的梯度与激活信息,生成更全面的注意力图
  • 引入偏置项提升特征重要性识别精度,解决传统方法忽略偏置的问题
  • 适用于复杂融合任务,适合需要可信AI解释的研究者和工程师

随着对可解释深度学习模型的需求增加,本文提出 Integrative CAM,一种先进的类激活映射(CAM)技术,旨在为卷积神经网络(CNNs)提供全局特征重要性视图。传统基于梯度的CAM方法(如 Grad-CAM、Grad-CAM++)仅依赖最终层激活来突出关注区域,常忽略中间层的关键特征。Integrative CAM 通过融合全网络层的信息,结合梯度与激活得分,自适应加权各层贡献,实现对模型内部表示的全面解读。该方法在显著性图计算中引入新颖的偏置项,这一因素在现有CAM技术中常被忽略,但对现代CNN的预测至关重要。此外,我们将 Grad-CAM++ 中的 alpha 项泛化至任意光滑函数,扩大了CAM在多种模型上的适用性。在多个复杂数据集上的大量实验表明,Integrative CAM 在特征重要性映射上表现出更高保真度,有效提升了复杂融合场景和复杂决策任务中的可解释性。通过捕捉多层次模型洞察,Integrative CAM 为融合驱动应用提供了有价值的可解释工具,推动深度学习模型的可信部署。

原文摘要 · Abstract (English)

With the growing demand for interpretable deep learning models, this paper introduces Integrative CAM, an advanced Class Activation Mapping (CAM) technique aimed at providing a holistic view of feature importance across Convolutional Neural Networks (CNNs). Traditional gradient-based CAM methods, such as Grad-CAM and Grad-CAM++, primarily use final layer activations to highlight regions of interest, often neglecting critical features derived from intermediate layers. Integrative CAM addresses this limitation by fusing insights across all network layers, leveraging both gradient and activation scores to adaptively weight layer contributions, thus yielding a comprehensive interpretation of the model's internal representation. Our approach includes a novel bias term in the saliency map calculation, a factor frequently omitted in existing CAM techniques, but essential for capturing a more complete feature importance landscape, as modern CNNs rely on both weighted activations and biases to make predictions. Additionally, we generalize the alpha term from Grad-CAM++ to apply to any smooth function, expanding CAM applicability across a wider range of models. Through extensive experiments on diverse and complex datasets, Integrative CAM demonstrates superior fidelity in feature importance mapping, effectively enhancing interpretability for intricate fusion scenarios and complex decision-making tasks. By advancing interpretability methods to capture multi-layered model insights, Integrative CAM provides a valuable tool for fusion-driven applications, promoting the trustworthy and insightful deployment of deep learning models.

可解释性CNN注意力图模型分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。