arXiv:2511.09239cs.CV2025-11

通过信息瓶颈原理提升视觉模型可解释性,让注意力聚焦真实特征。

Spatial Information Bottleneck for Interpretable Visual Recognition

  • 从信息论出发,用反向传播的梯度产物构建判别性特征编码
  • 在五个数据集上显著提升六种解释方法的前景集中度与背景抑制力
  • 无需针对特定方法调参,同时保持分类准确率不下降

深度神经网络通常学习到空间纠缠的表征,将判别性前景特征与虚假背景相关性混杂,损害模型可解释性与鲁棒性。本文从信息论视角重新理解基于梯度的归因,证明在弱条件下,反向传播中计算的向量-雅可比乘积(VJP)是输入特征关于类别标签的最小充分统计量。受此启发,提出编码-解码视角:前向传播将输入编码至类别空间,反向传播中的VJP则将该编码解码回特征空间。据此提出空间信息瓶颈(S-IB),通过最大化前景区域VJP与输入间的互信息,同时最小化背景区域的互信息,促使网络仅在与类别相关空间区域编码信息。由于后处理解释方法均源于VJP计算,直接在训练中优化VJP的空间结构,即可普遍提升多种解释范式下的可视化质量。五项基准实验表明,无需方法特异性调参,即可在六种解释方法中实现统一改进,获得更好的前景聚焦与背景抑制,同时保持分类精度一致提升。

原文摘要 · Abstract (English)

Deep neural networks typically learn spatially entangled representations that conflate discriminative foreground features with spurious background correlations, thereby undermining model interpretability and robustness. We propose a novel understanding framework for gradient-based attribution from an information-theoretic perspective. We prove that, under mild conditions, the Vector-Jacobian Products (VJP) computed during backpropagation form minimal sufficient statistics of input features with respect to class labels. Motivated by this finding, we propose an encoding-decoding perspective : forward propagation encodes inputs into class space, while VJP in backpropagation decodes this encoding back to feature space. Therefore, we propose Spatial Information Bottleneck (S-IB) to spatially disentangle information flow. By maximizing mutual information between foreground VJP and inputs while minimizing mutual information in background regions, S-IB encourages networks to encode information only in class-relevant spatial regions. Since post-hoc explanation methods fundamentally derive from VJP computations, directly optimizing VJP's spatial structure during training improves visualization quality across diverse explanation paradigms. Experiments on five benchmarks demonstrate universal improvements across six explanation methods, achieving better foreground concentration and background suppression without method-specific tuning, alongside consistent classification accuracy gains.

可解释性信息瓶颈视觉识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。