提出新方法揭示深度网络的语义特征,生成更可信的解释。
Pulling Back the Curtain on Deep Networks
- 将深层网络视为输入相关的仿射变换,反向推回神经元偏好方向
- 在多个模型上实现最佳解释忠实性与稳定性平衡,优于现有方法
- 适合需要可解释性的研究者和模型调试人员使用
在线性模型中,可视化权重向量可直接反映模型偏好的输入方向,但将此直觉推广至深度网络时,通过梯度或梯度上升得到的特征往往脆弱且具对抗性。我们提出,深度网络应被理解为输入条件化的仿射算子,其自然伴随作用可将神经元的偏好方向反向映射回输入空间。通过仅反向传播的软化与迭代增强,可重建目标神经元编码的连贯局部结构。该方法统一了SmoothGrad、B-cos对齐与特征强调等不同思路。所提出的语义反演(Semantic Pullbacks, SP)生成视觉一致、类别条件化的后验解释,突出语义相关特征,支持连贯的反事实扰动,并保持理论一致性。在ResNet50、VGG等卷积模型及PVT等基于Transformer的模型上,SP在忠实性、稳定性与目标敏感性基准测试中表现最优,兼具通用性、计算效率,且易于集成到现有深度学习流程中。
原文摘要 · Abstract (English)
In linear models, visualizing a weight vector naturally reveals the model's preferred input direction, but extending this intuition to deep networks via gradients or gradient ascent often yields brittle or adversarial-looking features. We argue that deep networks are better understood as input-conditioned affine operators, whose natural adjoint action pulls a neuron's preferred direction back to input space. We further refine this representation by backward-only softening and iterative enhancement to reconstruct coherent local structures encoded by the target neuron. This provides a unifying perspective on previously disparate ideas such as SmoothGrad, B-cos-style alignment, and Feature Accentuation. The resulting Semantic Pullbacks (SP) generate perceptually aligned, class-conditional post-hoc explanations that emphasize semantically meaningful features, facilitate coherent counterfactual perturbations, and remain theoretically grounded. Across convolutional architectures (ResNet50, VGG) and transformer-based models (PVT), Semantic Pullbacks achieve the best overall trade-off across faithfulness, stability, and target-sensitivity benchmarks, while remaining general, computationally efficient, and readily integrable into existing deep learning pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。