根据用户需求自动生成精准热力图,提升模型解释性。
Metric-Guided Synthesis of Class Activation Mapping
- 基于预设评估指标自动生成类激活映射表达式
- 在ResNet50/VGG16/VGG19上验证了热力图质量显著提升
- 适合需要定制化解释结果的研究者与应用开发者
类激活映射(CAM)是一类广泛使用的显著性方法,用于解释卷积神经网络(CNN)的行为。这类方法生成热力图,突出输入中对网络输出最相关的区域。已有多种CAM方法被提出,各自通过不同的表达式生成热力图。通常,用户希望热力图具备特定属性,如与真实标注的相似性、鲁棒性、等变性等。尽管现有方法在表达式中隐含部分属性,但无法根据用户意图或领域知识灵活调整热力图生成。本文提出SyCAM,一种基于度量的CAM表达式合成方法。给定一个预定义的显著性图评估指标,SyCAM可自动生成针对该指标优化的CAM表达式。我们特别探索了语法引导的合成实例,即在预设语法约束下,基于给定指标生成表达式。通过多个经典评估指标,验证了该方法在生成目标热力图方面的有效性和灵活性。我们在ResNet50、VGG16和VGG19三个主流模型上与多种知名CAM方法进行了对比。
原文摘要 · Abstract (English)
Class activation mapping (CAM) is a widely adopted class of saliency methods used to explain the behavior of convolutional neural networks (CNNs). These methods generate heatmaps that highlight the parts of the input most relevant to the CNN output. Various CAM methods have been proposed, each distinguished by the expressions used to derive heatmaps. In general, users look for heatmaps with specific properties that reflect different aspects of CNN functionality. These may include similarity to ground truth, robustness, equivariance, and more. Although existing CAM methods implicitly encode some of these properties in their expressions, they do not allow for variability in heatmap generation following the user's intent or domain knowledge. In this paper, we address this limitation by introducing SyCAM, a metric-based approach for synthesizing CAM expressions. Given a predefined evaluation metric for saliency maps, SyCAM automatically generates CAM expressions optimized for that metric. We specifically explore a syntax-guided synthesis instantiation of SyCAM, where CAM expressions are derived based on predefined syntactic constraints and the given metric. Using several established evaluation metrics, we demonstrate the efficacy and flexibility of our approach in generating targeted heatmaps. We compare SyCAM with other well-known CAM methods on three prominent models: ResNet50, VGG16, and VGG19.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。