arXiv:2512.18623cs.CLcs.AI2025-12中稿 · AAAI被引 13

动态扰动神经元,实时修正大模型幻觉。

LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correction

  • 用强化学习动态选择推理时的神经元扰动。
  • 在多个数据集上提升准确率,最高达10.98个百分点。
  • 无需修改参数,适合对可靠性要求高的场景。

大语言模型常生成缺乏事实或上下文依据的幻觉内容,限制其在关键应用中的可靠性。现有方法如监督微调和基于人类反馈的强化学习数据需求高且计算成本大,静态参数编辑方法则难以应对上下文相关的错误并易导致灾难性遗忘。本文提出LLM-CAS框架,将实时幻觉修正建模为分层强化学习问题。该框架训练一个智能体,根据当前上下文动态选择推理过程中的临时神经元扰动。与依赖启发式或预设调整的以往动态方法不同,此策略驱动机制可在不永久修改参数的前提下实现自适应、细粒度的纠正。多语言模型实验表明,LLM-CAS持续提升事实准确性,在StoryCloze上提升10.98个百分点,TriviaQA上提升2.71点,TruthfulQA的MC1得分提升2.06点。结果优于静态编辑方法(如ITI、CAA)和动态框架SADI。总体而言,LLM-CAS提供了一种高效且上下文感知的解决方案,显著提升大模型可靠性,未来有望扩展至多模态场景。

原文摘要 · Abstract (English)

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning from human feedback are data intensive and computationally expensive, while static parameter editing methods struggle with context dependent errors and catastrophic forgetting. We propose LLM-CAS, a framework that formulates real-time hallucination correction as a hierarchical reinforcement learning problem. LLM-CAS trains an agent to learn a policy that dynamically selects temporary neuron perturbations during inference based on the current context. Unlike prior dynamic approaches that rely on heuristic or predefined adjustments, this policy driven mechanism enables adaptive and fine grained correction without permanent parameter modification. Experiments across multiple language models demonstrate that LLM-CAS consistently improves factual accuracy, achieving gains of 10.98 percentage points on StoryCloze, 2.71 points on TriviaQA, and 2.06 points on the MC1 score of TruthfulQA. These results outperform both static editing methods such as ITI and CAA and the dynamic SADI framework. Overall, LLM-CAS provides an efficient and context aware solution for improving the reliability of LLMs, with promising potential for future multimodal extensions.

幻觉修正强化学习动态扰动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。