arXiv:2507.22832cs.LGcs.CV2025-07

提出新方法揭示深度网络的语义特征,生成更可信的解释。

Pulling Back the Curtain on Deep Networks

  • 将深层网络视为输入相关的仿射变换,反向推回神经元偏好方向
  • 在多个模型上实现最佳解释忠实性与稳定性平衡,优于现有方法
  • 适合需要可解释性的研究者和模型调试人员使用

在线性模型中,可视化权重向量可直接反映模型偏好的输入方向,但将此直觉推广至深度网络时,通过梯度或梯度上升得到的特征往往脆弱且具对抗性。我们提出,深度网络应被理解为输入条件化的仿射算子,其自然伴随作用可将神经元的偏好方向反向映射回输入空间。通过仅反向传播的软化与迭代增强,可重建目标神经元编码的连贯局部结构。该方法统一了SmoothGrad、B-cos对齐与特征强调等不同思路。所提出的语义反演(Semantic Pullbacks, SP)生成视觉一致、类别条件化的后验解释,突出语义相关特征,支持连贯的反事实扰动,并保持理论一致性。在ResNet50、VGG等卷积模型及PVT等基于Transformer的模型上,SP在忠实性、稳定性与目标敏感性基准测试中表现最优,兼具通用性、计算效率,且易于集成到现有深度学习流程中。

原文摘要 · Abstract (English)

In linear models, visualizing a weight vector naturally reveals the model's preferred input direction, but extending this intuition to deep networks via gradients or gradient ascent often yields brittle or adversarial-looking features. We argue that deep networks are better understood as input-conditioned affine operators, whose natural adjoint action pulls a neuron's preferred direction back to input space. We further refine this representation by backward-only softening and iterative enhancement to reconstruct coherent local structures encoded by the target neuron. This provides a unifying perspective on previously disparate ideas such as SmoothGrad, B-cos-style alignment, and Feature Accentuation. The resulting Semantic Pullbacks (SP) generate perceptually aligned, class-conditional post-hoc explanations that emphasize semantically meaningful features, facilitate coherent counterfactual perturbations, and remain theoretically grounded. Across convolutional architectures (ResNet50, VGG) and transformer-based models (PVT), Semantic Pullbacks achieve the best overall trade-off across faithfulness, stability, and target-sensitivity benchmarks, while remaining general, computationally efficient, and readily integrable into existing deep learning pipelines.

可解释性神经网络反向传播特征可视化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。