arXiv:2509.23849cs.CV2025-09ICCV被引 3

用激活图融合方法,让AI解释自己判断时依赖的视觉概念及其位置和贡献。

CE-FAM: Concept-Based Explanation via Fusion of Activation Maps

  • 通过分支网络与图像分类器共享激活图,用VLM知识自动识别概念。
  • 首次同时定位概念区域、量化其对分类的影响,并在未见概念上实现零样本推理。
  • 无需标注数据即可解释任意概念,适合需要可解释AI的科研与工业场景。

尽管显著性图能突出图像分类中重要的区域,但其含义需用户自行解读。相比之下,基于概念的解释将AI预测分解为人类可理解的概念,明确其贡献。然而,现有方法难以同时揭示图像分类器学习的概念、对应区域及其对预测的贡献。我们提出一种新方法——概念基于激活图融合(CE-FAM)。该方法采用共享激活图的分支网络,模仿视觉语言模型(VLM)的嵌入表示,预测图像中的概念。概念对应区域由激活图的加权和表示,权重来自概念预测得分的梯度;其贡献则基于对图像分类得分的影响进行量化。本方法提供通用框架,在不依赖标注数据的前提下,利用VLM知识处理任意概念。此外,我们引入新型评估指标以衡量概念区域准确性。定性和定量实验表明,该方法优于现有技术,尤其在未见概念的零样本推理中表现优异。

原文摘要 · Abstract (English)

Although saliency maps can highlight important regions to explain the reasoning behind image classification in artificial intelligence (AI), the meaning of these regions is left to the user's interpretation. In contrast, conceptbased explanations decompose AI predictions into humanunderstandable concepts, clarifying their contributions. However, few methods can simultaneously reveal what concepts an image classifier learns, which regions are associated with them, and how they contribute to predictions. We propose a novel concept-based explanation method, Concept-based Explanation via Fusion of Activation Maps (CE-FAM). It employs a branched network that shares activation maps with an image classifier and learns to mimic the embeddings of a Vision and Language Model (VLM). The branch network predicts concepts in an image, and their corresponding regions are represented by a weighted sum of activation maps, with weights given by the gradients of the concept prediction scores. Their contributions are quantified based on their impact on the image classification score. Our method provides a general framework for identifying the concept regions and their contributions while leveraging VLM knowledge to handle arbitrary concepts without requiring an annotated dataset. Furthermore, we introduce a novel evaluation metric to assess the accuracy of the concept regions. Our qualitative and quantitative evaluations demonstrate our method outperforms existing approaches and excels in zero-shot inference for unseen concepts.

可解释AI概念解释VLM零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。