融合梯度与区域信息,生成更准确的模型解释图。
Fusion-CAM: Integrating Gradient and Region-Based Class Activation Maps for Robust Visual Explanations
- 通过融合梯度与区域激活图,提升解释的完整性和清晰度。
- 在多个标准数据集上优于现有CAM方法,定量与定性表现均更优。
- 自适应融合机制能动态调整权重,适合复杂输入场景分析。
理解深度卷积神经网络的决策过程是实现可信、透明人工智能的核心挑战。可解释AI(XAI)技术中的类别激活图(CAM)方法被广泛用于可视化影响模型预测的输入区域。基于梯度的方法(如Grad-CAM)通过计算类别激活的梯度,提供精细但噪声大、覆盖不全的激活图,仅关注最显著区域;而基于区域的方法(如Score-CAM)通过聚合大区域信息,虽能覆盖更广物体,但存在过平滑、对细微特征不敏感的问题。本文提出Fusion-CAM,一种新框架,通过专用融合机制整合两类方法,生成鲁棒且高判别性的视觉解释。首先对梯度图去噪,获得更聚焦的激活;再结合优化后的梯度图与区域图,按贡献权重融合;最后采用自适应相似性像素级融合,评估两种范式的一致性并动态调节融合强度。该机制强化一致激活,软融合冲突区域,生成更丰富、具上下文感知、输入自适应的解释图。大量实验表明,Fusion-CAM在标准基准上持续优于现有CAM变体,在可视化质量与量化指标上均表现更佳,为深度神经网络解释提供了一种鲁棒且灵活的工具。
原文摘要 · Abstract (English)
Interpreting the decision-making process of deep convolutional neural networks remains a central challenge in achieving trustworthy and transparent artificial intelligence. Explainable AI (XAI) techniques, particularly Class Activation Map (CAM) methods, are widely adopted to visualize the input regions influencing model predictions. Gradient-based approaches (e.g. Grad-CAM) provide highly discriminative, fine-grained details by computing gradients of class activations but often yield noisy and incomplete maps that emphasize only the most salient regions rather than the complete objects. Region-based approaches (e.g. Score-CAM) aggregate information over larger areas, capturing broader object coverage at the cost of over-smoothing and reduced sensitivity to subtle features. We introduce Fusion-CAM, a novel framework that bridges this explanatory gap by unifying both paradigms through a dedicated fusion mechanism to produce robust and highly discriminative visual explanations. Our method first denoises gradient-based maps, yielding cleaner and more focused activations. It then combines the refined gradient map with region-based maps using contribution weights to enhance class coverage. Finally, we propose an adaptive similarity-based pixel-level fusion that evaluates the agreement between both paradigms and dynamically adjusts the fusion strength. This adaptive mechanism reinforces consistent activations while softly blending conflicting regions, resulting in richer, context-aware, and input-adaptive visual explanations. Extensive experiments on standard benchmarks show that Fusion-CAM consistently outperforms existing CAM variants in both qualitative visualization and quantitative evaluation, providing a robust and flexible tool for interpreting deep neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。