让大模型根据输入动态选择最佳引导方向,提升回答真实性。
IDEEA: training-free Input-Dependent stEEring via Activation cluster matching

- 通过激活聚类匹配,为不同输入生成专属引导方向。
- 在TruthfulQA上平均提升9.9%真实率(最高达23.5%)。
- 适合追求低成本、高精度推理调控的AI应用开发者。
指令对齐通过在推理时注入特定偏置激活来调整大语言模型,相比微调等方法成本更低。然而现有无需训练的对齐方法多为输入无关:仅拟合单一方向并适用于所有输入。这存在根本局限——不同输入占据激活空间的不同区域,同一目标概念应有不同最优引导方向,如同损失梯度随输入变化。本文提出IDEEA(基于激活聚类匹配的输入依赖式引导),为每个注意力头聚类正负激活支持集,并求解最优匹配问题,构建一组与聚类条件相关的引导方向。推理时,从该方向池中选取与当前输入激活最匹配的方向进行引导。实验表明,IDEEA在保持输入原表示的前提下实现目标概念对齐,证明概念激活存在于表征空间多个独立子区域。在TruthfulQA上,相比最佳输入无关基线,平均提升真实率9.9%(最高23.5%)。
原文摘要 · Abstract (English)
Steering aligns large language models (LLMs) by injecting a bias into selected activations at inference time, offering a far cheaper alternative to weight-update methods such as supervised fine-tuning or reinforcement learning. However, most existing training-free steering methods are input-independent: a single direction is fitted once and shared across all inputs. This is fundamentally limiting as different inputs occupy different regions of the activation space and admit different optimal steering directions toward the same target concept, much as the gradient with respect to a fixed loss varies from input to input. We close this gap with IDEEA (Input-Dependent stEEring via Activation cluster matching), a training-free framework for input-dependent steering. IDEEA clusters the positive and negative activation supports per attention head, and solves an optimal-matching problem to construct a set of cluster-conditional directions, all about the target concept. At inference time, it picks from this pool of directions and uses the one that best matches the input's own activation for steering. IDEEA aligns the model toward the target concept while preserving the input's original representation, evidence that activations encoding a concept occupy several distinct sub-regions of the representation space rather than a single one. IDEEA improves the truth $\times$ info rate in TruthfulQA by an average of 9.9% (up to 23.5%) over the best input-independent baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。