arXiv:2409.11123cs.AIcs.CV2024-09中稿 · IEEE Journal of Se…

无需梯度,用蒸馏法生成可解释性热图,适配各类模型。

Gradient-free Post-hoc Explainability Using Distillation Aided Learnable Approach

  • 用可学习的掩码网络与蒸馏网络联合优化生成显著区域
  • 在图像与音频分类任务中均超越9种现有方法
  • 仅需输入输出访问,适用于黑箱模型解释

近期人工智能的发展,尤其是多类大型模型仅提供查询接口,强烈推动了深度模型后验无梯度可解释性的需求。本文提出一种名为蒸馏辅助可解释性(DAX)的框架,旨在以模型无关、无梯度的方式生成基于显著性的解释。DAX将解释问题建模为可学习设置,包含掩码生成网络与学生蒸馏网络:前者学习生成用于定位输入显著区域的乘性掩码,后者则试图逼近黑箱模型的局部行为。通过使用局部扰动输入样本,并以黑箱模型的输入输出作为目标,对两个网络进行联合优化。我们在图像和音频两种模态下,针对分类任务,采用多种评估方式(与真实标注的交并比、删除法、人工主观评价)对DAX进行了全面评估,并与9种现有方法对比。实验结果表明,DAX在所有模态和评估指标上均显著优于现有方法。

原文摘要 · Abstract (English)

The recent advancements in artificial intelligence (AI), with the release of several large models having only query access, make a strong case for explainability of deep models in a post-hoc gradient free manner. In this paper, we propose a framework, named distillation aided explainability (DAX), that attempts to generate a saliency-based explanation in a model agnostic gradient free application. The DAX approach poses the problem of explanation in a learnable setting with a mask generation network and a distillation network. The mask generation network learns to generate the multiplier mask that finds the salient regions of the input, while the student distillation network aims to approximate the local behavior of the black-box model. We propose a joint optimization of the two networks in the DAX framework using the locally perturbed input samples, with the targets derived from input-output access to the black-box model. We extensively evaluate DAX across different modalities (image and audio), in a classification setting, using a diverse set of evaluations (intersection over union with ground truth, deletion based and subjective human evaluation based measures) and benchmark it with respect to $9$ different methods. In these evaluations, the DAX significantly outperforms the existing approaches on all modalities and evaluation metrics.

可解释性无梯度蒸馏热图生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。