arXiv:2410.12591cs.CVcs.AI2024-10ICLR被引 16

提出区域约束的视觉反事实解释,让模型推理更准确可信。

Rethinking Visual Counterfactual Explanations Through Region Constraint

  • 限定修改特定图像区域,避免全局干扰
  • 新方法在多个数据集上显著超越现有水平
  • 支持用户手动指定关注区域,提升可解释性

视觉反事实解释(VCEs)近年来成为揭示图像分类器决策过程的重要工具,其核心价值在于指出影响分类结果的语义因素。然而我们指出,当前先进方法缺乏关键的区域约束机制,导致解释不明确,甚至因确认偏误引发错误推理。为此,我们提出区域约束的视觉反事实解释(RVCE),假设仅预定义的图像区域可被修改以影响模型预测。为高效采样此类解释,我们提出区域约束反事实薛定谔桥(RCSB),将可解析的薛定谔桥适配至条件修复任务,其中条件信号来自目标分类器。实验表明,RCSB显著优于现有方法。此外,我们进一步拓展RCSB实现精确反事实推理——当预定义区域仅包含目标因素时;并支持用户主动设定区域,实现交互式解释。

原文摘要 · Abstract (English)

Visual counterfactual explanations (VCEs) have recently gained immense popularity as a tool for clarifying the decision-making process of image classifiers. This trend is largely motivated by what these explanations promise to deliver -- indicate semantically meaningful factors that change the classifier's decision. However, we argue that current state-of-the-art approaches lack a crucial component -- the region constraint -- whose absence prevents from drawing explicit conclusions, and may even lead to faulty reasoning due to phenomenons like confirmation bias. To address the issue of previous methods, which modify images in a very entangled and widely dispersed manner, we propose region-constrained VCEs (RVCEs), which assume that only a predefined image region can be modified to influence the model's prediction. To effectively sample from this subclass of VCEs, we propose Region-Constrained Counterfactual Schrödinger Bridges (RCSB), an adaptation of a tractable subclass of Schrödinger Bridges to the problem of conditional inpainting, where the conditioning signal originates from the classifier of interest. In addition to setting a new state-of-the-art by a large margin, we extend RCSB to allow for exact counterfactual reasoning, where the predefined region contains only the factor of interest, and incorporating the user to actively interact with the RVCE by predefining the regions manually.

反事实解释图像生成可解释AI条件修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。