无需梯度的可解释性方法,让模型解释更真实可信。
Derivative-Free Diffusion Manifold-Constrained Gradient for Unified XAI
- 用扩散模型和集合卡尔曼滤波逼近梯度,不依赖模型内部参数
- 生成的解释符合图像数据分布,避免虚假视觉内容
- 统一处理反事实生成与特征归因,性能超越现有方法
基于梯度的可解释性方法是图像模型解释的主流技术,但存在三方面缺陷:需白盒访问、易受对抗攻击、生成解释偏离图像数据流形,导致解释不忠实且不符合人类感知。为此,本文提出无导数扩散流形约束梯度(FreeMCG),通过集成卡尔曼滤波与扩散模型,仅利用模型输出即可获得投影到数据流形上的梯度近似。该方法在反事实生成与特征归因两大任务上均实现当前最优性能,同时保持可解释工具的核心特性,验证了其有效性与通用性。
原文摘要 · Abstract (English)
Gradient-based methods are a prototypical family of explainability techniques, especially for image-based models. Nonetheless, they have several shortcomings in that they (1) require white-box access to models, (2) are vulnerable to adversarial attacks, and (3) produce attributions that lie off the image manifold, leading to explanations that are not actually faithful to the model and do not align well with human perception. To overcome these challenges, we introduce Derivative-Free Diffusion Manifold-Constrainted Gradients (FreeMCG), a novel method that serves as an improved basis for explainability of a given neural network than the traditional gradient. Specifically, by leveraging ensemble Kalman filters and diffusion models, we derive a derivative-free approximation of the model's gradient projected onto the data manifold, requiring access only to the model's outputs. We demonstrate the effectiveness of FreeMCG by applying it to both counterfactual generation and feature attribution, which have traditionally been treated as distinct tasks. Through comprehensive evaluation on both tasks, counterfactual explanation and feature attribution, we show that our method yields state-of-the-art results while preserving the essential properties expected of XAI tools.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。