arXiv:2603.16335cs.LGcs.CL2026-03被引 1

用解码向量精准调控大模型自主行为,发现只有一条核心行动轴。

Behavioral Steering in a 35B MoE Language Model via SAE-Decoded Probe Vectors: One Agency Axis, Not Five Traits

  • 通过SAE解码探针向量,实现推理时无重训练的精细行为控制
  • 自主性增强2倍时,模型主动执行任务比例从22%升至78%,效应量达1.01
  • 五种行为特质实际由单一独立行动轴主导,适合研究模型决策机制的人

我们在Qwen 3.5-35B-A3B(一个350亿参数的混合门控DeltaNet/注意力架构MoE模型)的残差流上训练了九个稀疏自编码器(SAEs),用于识别并调控五种代理行为特征。方法是在线性探针上训练SAE潜在激活,再将探针权重通过SAE解码器投影回模型原始激活空间,获得连续可调的干预向量,绕过SAE的top-k离散化,实现无需重训练的细粒度行为干预。在1,800次智能体推演(50个场景×36种条件)中,自主性增强至2倍时,模型向用户求助的比例从78%降至22%,效应量为Cohen's d = 1.01(p < 0.0001)。跨特质分析显示,所有五个向量主要调节单一主导的代理轴(独立行动与服从用户之间的倾向),其他特质效应仅为工具使用构成和剂量反应形状的次要调制。工具使用向量产生显著影响(d = 0.39);风险校准向量仅表现为抑制作用。此外,仅在自回归解码阶段进行干预无效(p > 0.35),提供因果证据表明行为承诺在门控DeltaNet架构的预填充阶段生成。

原文摘要 · Abstract (English)

We train nine sparse autoencoders (SAEs) on the residual stream of Qwen 3.5-35B-A3B, a 35-billion-parameter Mixture-of-Experts model with a hybrid GatedDeltaNet/attention architecture, and use them to identify and steer five agentic behavioral traits. Our method trains linear probes on SAE latent activations, then projects the probe weights back through the SAE decoder to obtain continuous steering vectors in the model's native activation space. This bypasses the SAE's top-k discretization, enabling fine-grained behavioral intervention at inference time with no retraining. Across 1,800 agent rollouts (50 scenarios times 36 conditions), we find that autonomy steering at multiplier 2 achieves Cohen's d = 1.01 (p < 0.0001), shifting the model from asking the user for help 78% of the time to proactively executing code and searching the web. Cross-trait analysis, however, reveals that all five steering vectors primarily modulate a single dominant agency axis (the disposition to act independently versus defer to the user), with trait specific effects appearing only as secondary modulations in tool-type composition and dose-response shape. The tool-use vector steers behavior (d = 0.39); the risk-calibration vector produces only suppression. We additionally show that steering only during autoregressive decoding has zero effect (p > 0.35), providing causal evidence that behavioral commitments are computed during prefill in GatedDeltaNet architectures.

行为控制模型可解释性代理行为SAE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。