arXiv:2508.17540cs.LGcs.AI2025-08

提出线性传输算子,揭示大模型中特征如何沿残差流传递。

Activation Transport Operators

  • 设计线性映射捕捉特征跨层传输路径
  • 发现特征可被线性传递且效率有上限
  • 无需微调,适合安全检测与模型调试

残差流通过各解码器层间的线性读写实现通信。尽管基于稀疏字典学习的方法能定位残差流中的特征,激活修补方法可发现模型电路,但特征在残差流中如何流动仍缺乏研究。理解这一动态有助于增强越狱防护、提前发现并修正模型错误。本文提出激活传输算子(ATO),即从上游残差到下游残差(间隔k层)的线性映射,通过下游SAE解码器投影在特征空间评估。我们实证表明,该算子可判断特征是否由前层线性传输而来或由非线性层计算生成。我们引入传输效率概念,并给出其上界,用于估计对应线性传输的残差流子空间大小。实验验证了线性传输的存在,报告了传输效率及参与线性传输的残差流子空间规模。该方法计算轻量(无需微调,<50 GPU-h),为模型安全、调试和理解大模型中线性计算行为提供实用工具。

原文摘要 · Abstract (English)

The residual stream mediates communication between transformer decoder layers via linear reads and writes of non-linear computations. While sparse-dictionary learning-based methods locate features in the residual stream, and activation patching methods discover circuits within the model, the mechanism by which features flow through the residual stream remains understudied. Understanding this dynamic can better inform jailbreaking protections, enable early detection of model mistakes, and their correction. In this work, we propose Activation Transport Operators (ATO), linear maps from upstream to downstream residuals $k$ layers later, evaluated in feature space using downstream SAE decoder projections. We empirically demonstrate that these operators can determine whether a feature has been linearly transported from a previous layer or synthesised from non-linear layer computation. We develop the notion of transport efficiency, for which we provide an upper bound, and use it to estimate the size of the residual stream subspace that corresponds to linear transport. We empirically demonstrate the linear transport, report transport efficiency and the size of the residual stream's subspace involved in linear transport. This compute-light (no finetuning, <50 GPU-h) method offers practical tools for safety, debugging, and a clearer picture of where computation in LLMs behaves linearly.

大模型分析残差流线性传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。