通过固定噪声水平迭代优化,实现快速精准的视觉反事实解释。
FiRe: Fixed-Noise Refinement for Visual Counterfactual Explanations

- 在固定噪声水平下迭代精修,避免长轨迹去噪带来的复杂性。
- 推理速度提升3倍,计算量减少8倍,效果媲美或超越现有最佳方法。
- 适合需要高效生成高质量反事实图像的研究与应用。
视觉反事实解释旨在通过真实且局部化的编辑改变分类器决策,同时保留无关内容。现有基于DDPM的方法通常沿长的逆向去噪轨迹进行分类器引导编辑,噪声水平变化导致语义可编辑性与空间控制难以平衡,且编辑状态噪声大,而目标分类器训练于干净图像。因此,这些方法需昂贵的递归去噪或低质量单步估计来获取分类器可用的清晰图像。本文提出FiRe框架,在固定噪声水平下映射输入并迭代精修该噪声状态。为提供分类器引导所需的清晰图像,FiRe首次将像素均值流(Pixel Mean Flow)适配至反事实解释任务,实现从噪声状态直接预测清晰图像。为使固定噪声精修产生最小且局部的反事实编辑,FiRe引入三项专用控制:动态双掩码策略、自适应引导和提前停止机制,分别决定编辑位置、可见变化范围及停止时机。在三个数据集上的五个任务实验表明,相比最强近期基线,FiRe实现约3倍更快的在线推理速度,减少8倍浮点运算量,同时保持相当或顶尖的反事实质量。
原文摘要 · Abstract (English)
Visual counterfactual explanations aim to change classifier decisions through realistic and localized edits while preserving decision-irrelevant content. Existing DDPM-based methods typically perform classifier-guided editing along a long reverse denoising trajectory. The changing noise levels make semantic editability and spatial control difficult to balance, and the editable state is noisy, whereas the target classifier is trained on clean images. As a result, these methods require either costly recursive denoising or low-quality one-step estimates to obtain classifier-facing clean images. We propose FiRe, a Fixed-noise Refinement framework for visual counterfactual explanations. Rather than following a reverse denoising trajectory, FiRe maps the input to a fixed noise level and iteratively refines the noisy state at that level. To provide clean images for classifier guidance, FiRe first adapts Pixel Mean Flow to visual counterfactual explanation, enabling direct clean-image prediction from noisy states. To make fixed-noise refinement produce minimal and localized counterfactual edits, FiRe introduces three FiRe-specific controls: a dynamic dual-mask strategy, adaptive guidance, and early stopping, which determine where edits accumulate, which changes become visible, and when refinement stops. Experiments on five tasks across three datasets show that, compared with the strongest recent baseline, FiRe achieves about 3$\times$ faster online inference and 8$\times$ fewer FLOPs while obtaining comparable or state-of-the-art counterfactual quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。