arXiv:2505.22572cs.CLcs.AI2025-05

通过动态注入提示特定激活值,提升大模型问答准确性。

Fusion Steering: Prompt-Specific Activation Control

  • 按提示动态调整全层激活,实现精准干预。
  • 在260个难题上准确率达25.4%,显著优于基线3.5%。
  • 适合需要高精度问答的场景,支持稀疏表示扩展。

本文提出Fusion Steering,一种用于提升大语言模型(LLM)问答任务事实准确性的激活控制方法。该方法引入灵活的全层与分段控制配置,通过在所有Transformer层动态注入提示相关的激活增量,实现更精准的干预。这些增量基于包含真实答案与模型生成解释的参考输出,以增强语义丰富性。注入权重使用Optuna针对联合目标优化,兼顾词元重叠(事实对齐)与困惑度(流畅性代理)。评估采用综合得分,涵盖事实准确性、连贯性与相关性。在260个基础模型失败的SimpleQA提示上测试,使用8位量化版Gemma-2-2B-IT,分段控制达到25.4%准确率(得分≥0.6),优于基线3.5%和全层控制16.2%;在更严格的SimpleQA标准下,完全正确响应从0.0%提升至13.1%。结果表明,分段动态干预策略有效,且支持稀疏表示(如Neuronpedia或稀疏交叉编码器),为可解释、可扩展的激活级控制提供新方向。

原文摘要 · Abstract (English)

We present Fusion Steering, an activation steering methodology that improves factual accuracy in large language models (LLMs) for question-answering (QA) tasks. This approach introduces flexible steering configurations, including full-layer steering and segmented steering. Unlike traditional methods constrained to single-layer or fixed-layer operations, Fusion Steering employs dynamic injection of prompt-specific activation deltas across all transformer layers. These activation deltas are derived from reference completions that combine the ground-truth answer with a model-generated explanation to facilitate semantically enriched, example-specific steering. The injection weights are optimized per prompt using Optuna, targeting a joint objective that balances token overlap (factual alignment) and perplexity (fluency proxy). Evaluation employs a composite score integrating token overlap and LLM-graded quality, encompassing factual accuracy, coherence, and relevance. Empirical results on 260 SimpleQA prompts (selected from 500 where the baseline failed) showcase the efficacy of segmented steering. Using Gemma-2-2B-IT with 8-bit quantization, segmented steering achieves an accuracy of 25.4% (outputs scoring $\geq 0.6$), outperforming the baseline at 3.5% and full-layer steering at 16.2%. Under the stricter SimpleQA rubric, segmented steering boosts fully correct responses from 0.0% to 13.1%. These findings highlight the strengths of segmented, dynamic intervention strategies and the promise of per-prompt, full-network activation control. Fusion Steering is also amenable to sparse representations, such as Neuronpedia or sparse crosscoders, suggesting a promising direction for interpretable and scalable activation-level control in LLMs.

大模型问答系统激活控制精准生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。