arXiv:2604.15488cs.LGcs.AI2026-04ACL

让大模型在推理时精准调整行为,既安全又不伤性能。

FineSteer: A Unified Framework for Fine-Grained Inference-Time Steering in Large Language Models

论文配图:FineSteer: A Unified Framework for Fine-Grained Inference-Time Steering in Large Language Models
图 1 · 摘自论文原文
  • 分两步控制:先判断是否需要调整,再生成针对性修正向量。
  • 在安全性和真实性测试中表现优于现有方法,几乎不损失原模型能力。
  • 适合需要灵活调控大模型输出的开发者和研究人员。

大型语言模型常出现安全违规和幻觉等问题。尽管推理时调控是一种无需更新参数的低成本调节方式,但现有方法因设计僵化、适应性差,难以同时保证效果、保留模型实用性与训练效率。本文提出FineSteer框架,将推理时调控分解为两个互补阶段:条件调控与细粒度向量合成,实现对内部表示何时何地进行调整的精细控制。第一阶段引入子空间引导的条件调控(SCS)机制,通过避免无谓调控来保持模型原始能力。第二阶段提出调控专家混合(MoSE)机制,捕捉目标行为的多模态特性,生成查询相关的调控向量以提升有效性。通过在SCS与MoSE中的定制化设计,FineSteer在通用查询上保持稳健性能的同时,能自适应优化特定输入的调控向量,且训练高效。大量实验表明,在安全性和真实性基准测试中,FineSteer全面超越现有先进方法,实现更强调控效果且几乎无性能损失。代码已开源:https://github.com/YukinoAsuna/FineSteer。

原文摘要 · Abstract (English)

Large language models (LLMs) often exhibit undesirable behaviors, such as safety violations and hallucinations. Although inference-time steering offers a cost-effective way to adjust model behavior without updating its parameters, existing methods often fail to be simultaneously effective, utility-preserving, and training-efficient due to their rigid, one-size-fits-all designs and limited adaptability. In this work, we present FineSteer, a novel steering framework that decomposes inference-time steering into two complementary stages: conditional steering and fine-grained vector synthesis, allowing fine-grained control over when and how to steer internal representations. In the first stage, we introduce a Subspace-guided Conditional Steering (SCS) mechanism that preserves model utility by avoiding unnecessary steering. In the second stage, we propose a Mixture-of-Steering-Experts (MoSE) mechanism that captures the multimodal nature of desired steering behaviors and generates query-specific steering vectors for improved effectiveness. Through tailored designs in both SCS and MoSE, FineSteer maintains robust performance on general queries while adaptively optimizing steering vectors for targeted inputs in a training-efficient manner. Extensive experiments on safety and truthfulness benchmarks show that FineSteer outperforms state-of-the-art methods in overall performance, achieving stronger steering performance with minimal utility loss. Code is available at https://github.com/YukinoAsuna/FineSteer

大模型调控推理时优化安全性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。