arXiv:2603.13652cs.CV2026-03被引 2

通过直接干预内部激活,更准确地定位图像块对视觉Transformer预测的影响。

Causal Attribution via Activation Patching

  • 在中间层直接替换图像块的激活值,评估其对预测的因果影响。
  • 在多个ViT模型上优于现有方法,定位更精准,结果更可信。
  • 适合需要解释模型决策过程的研究者,尤其关注可解释性与空间精度。

视觉Transformer(ViTs)的归因方法旨在识别影响模型预测的图像区域,但生成忠实且精确定位的归因仍具挑战。现有方法存在局限:基于梯度、相关性传播和注意力的方法依赖局部近似,而扰动或优化方法则作用于输入、标记或代理,而非内部块表示。关键问题在于,类别相关证据由跨层块标记间的交互形成;仅操作输入变化、注意力权重或反向相关信号的方法可能仅提供间接代理,而非直接测试上下文化块表示的预测效应。我们提出因果归因激活补丁法(CAAP),通过直接干预内部激活来估计单个图像块对ViT预测的贡献。对每个块,CAAP将源图像激活插入中层范围的中性目标上下文中,并使用生成的目标类别得分作为归因信号。所得归因图反映了块相关内部表示对模型预测的因果贡献。该因果干预通过捕捉初始表征形成后的语义证据,提供了一种原则性的块影响力度量,同时避免晚期层全局混合导致的空间特异性下降。在多个ViT主干网络和标准指标下,CAAP在各种设置中均持续优于现有方法,产生更忠实且局部化的归因。

原文摘要 · Abstract (English)

Attribution methods for Vision Transformers (ViTs) aim to identify image regions that influence model predictions, but producing faithful and well-localized attributions remains challenging. Existing attribution methods face several limitations, with gradient-based, relevance-propagation, and attention-based methods relying on local approximations, while perturbation or optimization-based methods intervene on inputs, tokens, or surrogates rather than internal patch representations. The key challenge is that class-relevant evidence is formed through interactions between patch tokens across layers; methods that operate only on input changes, attention weights, or backward relevance signals may therefore provide indirect proxies for patch importance rather than directly testing the predictive effect of contextualized patch representations. We propose Causal Attribution via Activation Patching (CAAP), which estimates the contribution of individual image patches to the ViT's prediction by directly intervening on internal activations rather than using learned masks or synthetic perturbation patterns. For each patch, CAAP inserts the corresponding source-image activations into a neutral target context over an intermediate range of layers and uses the resulting target-class score as the attribution signal. The resulting attribution map reflects the causal contribution of patch-associated internal representations on the model's prediction. The causal intervention serves as a principled measure of patch influence by capturing semantic evidence after initial representation formation, while avoiding late-layer global mixing that can reduce spatial specificity. Across multiple ViT backbones and standard metrics, CAAP consistently outperforms existing methods in various settings and produces more faithful and localized attributions.

可解释性视觉Transformer因果归因

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。