arXiv:2603.02237cs.LGcs.AI2026-03

让大模型按需调整行为,更精准地控制概念表达。

Concept Heterogeneity-aware Representation Steering

  • 用最优传输理论建模概念分布差异,生成动态调节方向
  • 在多个数据集上比传统全局调节方法提升控制效果
  • 适合需要精细调控大模型行为的场景,如安全对齐

表示调控行为通过在推理时干预内部激活,实现对大语言模型行为的轻量级控制。现有方法通常依赖单一全局调控行方向,基于对比数据集的均值差获得。该方法隐含假设目标概念在嵌入空间中均匀分布,但实际中语言模型的表示常呈现簇状、上下文依赖结构,导致全局调控行为脆弱。本文从最优传输(OT)视角重新审视调控行为,指出标准均值差调控行为对应于两个相同分布但一阶矩不同的OT映射,即全局平移。为放宽此限制,我们理论建模源与目标表示为高斯混合模型,并将调控行为形式化为语义潜在簇之间的离散最优传输问题。由此产生的传输方案通过巴氏投影生成显式、输入相关的调控行图,实现簇级偏移的平滑核加权组合。提出的方法称为概念异质性感知表示调控行(CHaRS)。大量实验表明,相较于全局调控行,CHaRS在多种设置下展现出更有效的行为控制能力。

原文摘要 · Abstract (English)

Representation steering offers a lightweight mechanism for controlling the behavior of large language models (LLMs) by intervening on internal activations at inference time. Most existing methods rely on a single global steering direction, typically obtained via difference-in-means over contrastive datasets. This approach implicitly assumes that the target concept is homogeneously represented across the embedding space. In practice, however, LLM representations can be highly non-homogeneous, exhibiting clustered, context-dependent structure, which renders global steering directions brittle. In this work, we view representation steering through the lens of optimal transport (OT), noting that standard difference-in-means steering implicitly corresponds to the OT map between two identical distributions with differing first moments, yielding a global translation. To relax this restrictive assumption, we theoretically model source and target representations as Gaussian mixture models and formulate steering as a discrete OT problem between semantic latent clusters. From the resulting transport plan, we derive an explicit, input-dependent steering map via barycentric projection, producing a smooth, kernel-weighted combination of cluster-level shifts. We term this method Concept Heterogeneity-aware Representation Steering (CHaRS). Through numerous experimental settings, we show that CHaRS yields more effective behavioral control than global steering.

表示调控行最优传输大模型控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。