arXiv:2607.14743cs.CV2026-07

不同扰动设置会让模型解释结果大相径庭,需谨慎选择。

On the Disagreement in Perturbation-based xAI -- Benchmarking Perturbation Choices for Flood Detection from SAR Images

论文配图:On the Disagreement in Perturbation-based xAI -- Benchmarking Perturbation Choices for Flood Detection from SAR Images
图 1 · 摘自论文原文
  • 对比多种扰动块的大小形状与替换方式对解释的影响
  • 发现不同设置下热力图差异显著,甚至相互矛盾
  • 适合关注模型可解释性可靠性的遥感与深度学习研究者

基于扰动的可解释性方法广泛用于分析深度学习模型的行为。通过改变输入区域并测量类别概率变化,生成反映各区域贡献度的热力图。然而,这类方法对参数选择敏感。本文聚焦扰动流程中的两个关键参数:扰动块的几何特性(大小、形状)和扰动类型(替换方案)。以合成孔径雷达图像洪水检测为应用场景,系统考察不同扰动设置下相关性估计的变化。不仅进行热力图视觉评估,还衡量其在不同策略间的稳定性及对模型推理的忠实度。结果表明,不同扰动选择会显著改变解释结果,导致模糊甚至矛盾的解释。研究强调了扰动设置在可解释性分析中的关键作用,呼吁在解读解释时应将其作为核心环节加以审慎评估,以确保对模型预测与解释的稳健理解。

原文摘要 · Abstract (English)

Perturbation-based xAI methods are widely used to analyze the behavior and predictions of deep learning models. By altering input regions and measuring the resulting changes in class probabilities with respect to the original image, they assign relevance scores and generate heatmaps that reflect each region's contribution to the prediction. Despite their apparent simplicity, however, perturbation-based methods are sensitive to parameter choices. In this work, we focus on two key parameters of the perturbation pipeline, namely the patch geometry, including the size and shape of the perturbed regions, and the perturbation type, defined by the replacement scheme. Grounded in the use case of flood detection from Synthetic Aperture Radar imagery, we conduct a comprehensive investigation of how relevance estimation changes under different perturbation settings. Beyond visual inspection of the resulting relevance maps, we evaluate their consistency across perturbation strategies and their faithfulness to the model's reasoning. We demonstrate how different perturbation choices can steer the resulting relevance maps, yielding ambiguous and even contradictory explanations. Our findings emphasize the importance of methodological settings in perturbation-based xAI. They underscore the need to carefully inspect and evaluate perturbation choices and to treat them as an integral part when interpreting explanations, ensuring a robust understanding of both the explanations and model predictions.

可解释性遥感图像扰动分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。