arXiv:2510.08646cs.LGcs.AI2025-10ACL被引 4

通过推理时能量调控,减少大模型误拒正常请求。

Mitigating Over-Refusal in Aligned Large Language Models via Inference-Time Activation Energy

  • 用轻量外部模型在推理时动态调整内部状态能量
  • 在ORB-H测试中合规率从57.3%提升至82.6%
  • 不修改模型参数,适合安全对齐场景

当前大模型的安全对齐面临核心挑战:现有对齐技术常过度防范有害提示,导致误拒正常请求。本文提出无需微调的能源景观引导(ELS)框架,在推理阶段通过外部能量模型动态干预。训练一个轻量级基于能量的模型(EBM),为不良状态(误拒或越狱)赋予高能量,为理想状态(有用回复或安全拒绝)赋予低能量。推理时,EBM将语言模型内部激活映射到能量空间,利用能量梯度实时引导隐藏状态向低能量区域移动,从而动态引导模型趋向理想行为,且不改变模型参数。跨多种模型的实验表明,该方法将ORB-H基准上的合规率从57.3%提升至82.6%,同时保持原有安全性能,为实现高安全性与低误拒率提供新范式。

原文摘要 · Abstract (English)

Safety alignment of large language models currently faces a central challenge: existing alignment techniques often prioritize mitigating responses to harmful prompts at the expense of overcautious behavior, leading models to incorrectly refuse benign requests. A key goal of safe alignment is therefore to improve safety while simultaneously minimizing false refusals. In this work, we introduce Energy Landscape Steering (ELS), a novel, fine-tuning free framework designed to resolve this challenge through dynamic, inference-time intervention. We train a lightweight external Energy-Based Model (EBM) to assign high energy to undesirable states (false refusal or jailbreak) and low energy to desirable states (helpful response or safe reject). During inference, the EBM maps the LLM's internal activations to an energy landscape, and we use the gradient of the energy function to steer the hidden states toward low-energy regions in real time. This dynamically guides the model toward desirable behavior without modifying its parameters. By decoupling behavioral control from the model's core knowledge, ELS provides a flexible and computationally efficient solution. Extensive experiments across diverse models demonstrate its effectiveness, raising compliance on the ORB-H benchmark from 57.3 percent to 82.6 percent while maintaining baseline safety performance. Our work establishes a promising paradigm for building LLMs that simultaneously achieve high safety and low false refusal rates.

安全对齐推理干预能量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。