arXiv:2607.12526cs.LG2026-07

让神经网络的特征可视化更精准,能还原具体输入的细节。

From Preimage Search To Source-Grounded Feature Inversion

论文配图:From Preimage Search To Source-Grounded Feature Inversion
图 1 · 摘自论文原文
  • 基于源输入的局部结构重构特征,避免模糊匹配。
  • 仅需一次反向传播即可完成高精度特征逆映射。
  • 适用于多种模型与数据,无需为每张图重新训练。

解释神经网络需要理解其内部特征从特定输入中提取的内容。特征逆映射旨在将选定特征还原到输入域,但传统迭代方法仅寻找一个重编码后匹配目标的输入,而多个输入可能满足此条件,导致逆映射缺乏唯一性。本文提出源基特征逆映射,通过约束逆映射依赖于生成目标的样本所在位置的局部网络几何结构。在计算有向无环图(DAG)边界处,反向传播提供正确的反向依赖关系,但传递的是伴随信号而非上游状态估计。我们通过闭式矩阵维纳映射,将均值种子的向量-雅可比乘积(VJP)修复为上游状态,并对前向一致性残差进行第二次维纳映射,再通过同一DAG在单次有限反向传递中组合修复状态。一个校准的零截距映射族可在不同输入、深度、通道数和通道组下,适用于多种卷积神经网络与Transformer架构、张量组件及视觉分布,无需查询特定优化。目标与源控制匹配验证了每个逆映射依赖于所选特征及被解释样本的局部算子,而非目标无关的图像模板。预测条件化的特征图谱使这些可视化与对应内部特征的独立干预对齐。整体上,源基特征逆映射使模型的隐藏特征层次可在单层与单通道层面被观察,将网络从输入中提取的内容与其内部决策依据联系起来。

原文摘要 · Abstract (English)

Interpreting a neural network requires understanding what its internal features extract from a particular input. Feature inversion seeks to express a selected feature in the input domain, but canonical iterative methods search for an input whose re-encoded representation matches the target. Because many inputs can satisfy this constraint, target matching alone does not specify the inverse associated with the sample that generated the feature. We formulate source-grounded feature inversion by conditioning the inverse on the source-local network geometry at the target-generating input. At each boundary of the computational DAG, backpropagation provides the correct reverse dependencies but transports an adjoint signal rather than an upstream-state estimate. We locally repair this signal with a closed-form matrix Wiener map from a mean-seed VJP to the upstream state, followed by a second Wiener map for the JVP forward-consistency residual, and compose the repaired states through the same DAG in one finite reverse pass. One calibrated zero-intercept map family supports new inputs, depths, channels, and channel groups across diverse CNN and Transformer architectures, tensor components, and visual distributions without query-specific optimisation. Matched target and source controls verify that each inverse depends on the selected feature and the local operators of the sample being explained, rather than a target-independent image template. Prediction-conditioned feature atlases align these visualisations with independent interventions on the corresponding internal features. Together, source-grounded feature inversion opens the model's hidden feature hierarchy to inspection at the level of individual layers and channels, linking what the network extracts from an input to the internal evidence that shapes its decision.

特征可视化神经网络解释反向传播模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。