arXiv:2609.07037cs.LG2026-09

将大模型控制向量拆解为独立语义单元,实现精准行为调控。

Disentangling Steering Vectors

论文配图:Disentangling Steering Vectors
图 1 · 摘自论文原文
  • 通过正负激活差分生成实例级向量,再用稀疏自编码器分离语义成分。
  • 在两个数据集、两模型、两深度下验证,向量语义一致且可区分。
  • 适用于需要精细控制大模型输出的场景,如风格/内容分离编辑。

激活操控已成为一种轻量级的推理时方法,用于控制大语言模型(LLM)的行为。然而,传统基于均值差等方法生成的操控向量常将多个语义与风格概念纠缠于单一方向,导致操控效果不可预测。本文核心目标是将这种复合方向拆解为独立语义成分。为此,提出操控向量解耦框架:通过配对正负激活并取差值生成实例级操控向量,并直接在这些向量上训练专用稀疏自编码器(SAE)。在两个数据集、两个模型和两个干预深度上的定量评估表明,该方法生成的一组语义一致的基础向量具有可区分的操控效果。此外,解耦能力使模型行为得以精确控制。

原文摘要 · Abstract (English)

Activation steering has emerged as a lightweight, inference-time approach to control the behavior of Large Language Models (LLMs). However, traditional steering vectors used to intervene in LLMs' activations, such as those derived from the difference-in-means method, tend to entangle multiple semantic and stylistic concepts into a single composite direction, leading to unpredictable steering effects. Our core objective is to disentangle this composite direction into its constituent concepts. To this end, we propose Steering Vector Dissection, a framework to explicitly isolate individual and semantically consistent features from these composite directions. Specifically, we pair positive and negative activations and take their differences to generate a set of instance-level steering vectors, and train a dedicated Sparse Autoencoder (SAE) directly on them. Quantitative evaluations across two datasets, two models, and two intervention depths show that our method yields a set of semantically consistent basis vectors whose steering effects are mutually distinguishable. Furthermore, we show that this disentanglement enables precise control over model behaviors.

大模型控制向量解耦语义分离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。