通过实时抑制错误生成神经元,提升大模型事实准确性而不损通用能力。
Adaptive Activation Cancellation for Hallucination Mitigation in Large Language Models
- 将幻觉激活视为残差流中的干扰,用自适应方法实时抑制特定神经元。
- 在三个模型上均提升事实准确率,且在所有模型上保持0%性能退化。
- 无需微调或外部知识,适合对事实性要求高的生成场景使用。
大型语言模型常生成流畅但事实错误的内容。本文提出自适应激活消融(AAC),一种推理时的实时框架,将与幻觉相关的神经激活视为变压器残差流中的结构化干扰,借鉴信号处理中的自适应噪声抵消思想。通过逐层线性探测识别幻觉节点(H-Nodes),并在自回归生成中使用置信度加权前向钩子进行抑制——无需外部知识、无需微调、无需额外推理步骤。在OPT-125M、Phi-3-mini和LLaMA 3-8B三个模型上,针对TruthfulQA和HaluEval的评估显示,该实时钩子是唯一在所有规模上均持续提升下游准确率的干预手段。关键的是,该方法具有严格局部性:WikiText-103困惑度和MMLU推理准确率在所有模型上均无任何下降(0.0%退化)。在LLaMA 3-8B上,该方法还带来生成层面的正向提升(MC1 +0.04;MC2 +0.003;Token-F1 +0.003),同时探针空间选择性比ITI基线高出5.94倍至3.5倍,证明了针对性的神经元级抑制可同时提升事实准确性并保留模型能力。
原文摘要 · Abstract (English)
Large Language Models frequently generate fluent but factually incorrect text. We propose Adaptive Activation Cancellation (AAC), a real-time inference-time framework that treats hallucination-associated neural activations as structured interference within the transformer residual stream, drawing an explicit analogy to classical adaptive noise cancellation from signal processing. The framework identifies Hallucination Nodes (H-Nodes) via layer-wise linear probing and suppresses them using a confidence-weighted forward hook during auto-regressive generation -- requiring no external knowledge, no fine-tuning, and no additional inference passes. Evaluated across OPT-125M, Phi-3-mini, and LLaMA 3-8B on TruthfulQA and HaluEval, the real-time hook is the only intervention that consistently improves downstream accuracy on all three scales. Critically, the method is strictly surgical: WikiText-103 perplexity and MMLU reasoning accuracy are preserved at exactly 0.0% degradation across all three model scales, a property that distinguishes AAC from interventions that trade fluency or general capability for factual improvement. On the LLaMA 3-8B scale, the hook additionally yields positive generation-level gains (MC1 +0.04; MC2 +0.003; Token-F1 +0.003) while achieving probe-space selectivity 5.94x - 3.5x higher than the ITI baseline -- demonstrating that targeted neuron-level suppression can simultaneously improve factual accuracy and preserve model capability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。