通过轻量平滑提升对抗训练生成的显著图稳定性与可信度
Training for Trustworthy Saliency Maps: Adversarial Training Meets Feature-Map Smoothing
- 在对抗训练中加入可微高斯滤波层,平滑中间特征图
- 显著提升输入与输出侧稳定性,且保持稀疏性优势
- 适用于对解释可信度要求高的医疗、金融等高风险场景
基于梯度的显著性方法(如原始梯度和积分梯度)广泛用于解释图像分类器,但生成的显著图常噪声大且不稳定,限制了其在高风险场景的应用。现有工作多通过改进归因算法提升解释质量,却忽视了训练过程对解释性能的影响。本文从训练视角出发,提出基于曲率的分析,揭示归因稳定性与输入梯度场局部平滑性的关联。研究发现,对抗训练虽能提升显著图稀疏性和输入稳定性,但会损害输出侧稳定性——即使预测不变、logits仅微小变化,解释仍会剧烈改变。为此,我们引入轻量级特征图平滑模块,在中间层应用可微高斯滤波。在FMNIST、CIFAR-10和ImageNette上实验表明,该方法在保留对抗训练稀疏性优势的同时,显著提升了输入与输出侧稳定性。65名参与者的人类评估显示,平滑后的对抗显著图被感知为更充分、更可信。结果表明,训练方式深刻影响解释质量,而结合稳健训练与简单平滑是实现稀疏且稳定的显著图的可行路径。
原文摘要 · Abstract (English)
Gradient-based saliency methods such as Vanilla Gradient (VG) and Integrated Gradients (IG) are widely used to explain image classifiers, yet the resulting maps are often noisy and unstable, limiting their usefulness in high-stakes settings. Most prior work improves explanations by modifying the attribution algorithm, leaving open how the training procedure shapes explanation quality. We take a training-centered view and first provide a curvature-based analysis linking attribution stability to how smoothly the input-gradient field varies locally. Guided by this connection, we study adversarial training and identify a consistent trade-off: it yields sparser and more input-stable saliency maps, but can degrade output-side stability, causing explanations to change even when predictions remain unchanged and logits vary only slightly. To mitigate this, we propose augmenting adversarial training with a lightweight feature-map smoothing block that applies a differentiable Gaussian filter in an intermediate layer. Across FMNIST, CIFAR-10, and ImageNette, our method preserves the sparsity benefits of adversarial training while improving both input-side stability and output-side stability. A human study with 65 participants further shows that smoothed adversarial saliency maps are perceived as more sufficient and trustworthy. Overall, our results demonstrate that explanation quality is critically shaped by training, and that simple smoothing with robust training provides a practical path toward saliency maps that are both sparse and stable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。