arXiv:2502.12108cs.LGcs.AI2025-02被引 3

用测地线替代直线,让深度模型归因更准确。

Using the Path of Least Resistance to Explain Deep Networks

  • 以模型雅可比矩阵定义黎曼度量,沿测地线积分梯度。
  • 在图像分类任务中,新方法归因更忠实于真实重要性。
  • 适合需要可信解释的AI应用,如医疗诊断与金融风控。

集成梯度(IG)是一种广泛使用的路径基归因方法,通过沿从基准到输入的直线路径积分模型梯度来分配输入特征的重要性。尽管在某些情况下有效,我们发现直线路径可能导致错误的归因。本文揭示了这一问题的根源,并提出一种新方法:利用被解释模型的雅可比矩阵构建输入空间上的模型诱导黎曼度量,沿该度量下的测地线积分梯度,称为测地线集成梯度(GIG)。为近似测地线路径,我们引入两种技术:小模型采用k-近邻法,大模型采用随机变分推断法。此外,我们提出新公理‘无抵消完备性’(NCC),强化完备性,排除特征间抵消。理论上证明,路径基归因在模型诱导度量下满足NCC当且仅当路径为测地线。在合成与真实图像分类数据集上的实验验证了理论分析,表明GIG在所考察基准上优于现有方法(包括IG),产生更忠实的归因结果。

原文摘要 · Abstract (English)

Integrated Gradients (IG), a widely used axiomatic path-based attribution method, assigns importance scores to input features by integrating model gradients along a straight path from a baseline to the input. While effective in some cases, we show that straight paths can lead to flawed attributions. In this paper, we identify the cause of these misattributions and propose an alternative approach that equips the input space with a model-induced Riemannian metric (derived from the explained model's Jacobian) and computes attributions by integrating gradients along geodesics under this metric. We call this method Geodesic Integrated Gradients (GIG). To approximate geodesic paths, we introduce two techniques: a k-Nearest Neighbours-based approach for smaller models and a Stochastic Variational Inference-based method for larger ones. Additionally, we propose a new axiom, No-Cancellation Completeness (NCC), which strengthens completeness by ruling out feature-wise cancellation. We prove that, for path-based attributions under the model-induced metric, NCC holds if and only if the integration path is a geodesic. Through experiments on both synthetic and real-world image classification data, we provide empirical evidence supporting our theoretical analysis and showing that GIG produces more faithful attributions than existing methods, including IG, on the benchmarks considered.

模型解释归因方法测地线

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。