arXiv:2510.02324cs.CLcs.AI2025-10被引 7

让大模型学会识别未知,自动拒绝不懂的问题,减少幻觉。

Hallucination reduction with CASAL: Contrastive Activation Steering For Amortized Learning

  • 通过对比激活调控,把防幻觉能力直接学进模型权重里。
  • 在多个问答任务上降低30%-40%幻觉率,且效果稳定。
  • 训练轻量高效,适合数据少或资源受限的场景。

大型语言模型虽强大却常产生幻觉,自信地给出错误答案。已有研究发现模型能线性表征自身知识,且激活调控可抑制幻觉,但需实时干预。本文提出对比激活调控的摊销学习方法(CASAL),将调控能力直接融入模型权重。训练后,模型能识别已知问题并拒绝未知问题。CASAL仅需训练单个注意力层的子模块,即可在多个短文本问答基准上实现30%-40%的幻觉率下降。相比强基线如SFT和DPO,其计算效率提升30倍,数据效率提升20倍,适用于数据稀缺领域。更重要的是,它在分布外(OOD)场景下仍具泛化能力。该方法成功应用于纯文本与视觉-语言模型,是首个在密集型与专家混合(MoE)模型中均有效的基于调控的训练方法,为可解释性驱动的生产部署提供了新路径。

原文摘要 · Abstract (English)

Large Language Models (LLMs) exhibit impressive capabilities but often hallucinate, confidently providing incorrect answers instead of admitting ignorance. Prior work has shown that models encode linear representations of their own knowledge and that activation steering can reduce hallucinations. These approaches, however, require real-time monitoring and intervention during inference. We introduce Contrastive Activation Steering for Amortized Learning (CASAL), an efficient algorithm that connects interpretability with amortized optimization. CASAL directly bakes the benefits of activation steering into model's weights. Once trained, LLMs answer questions they know while abstaining from answering those they do not. CASAL's light-weight design requires training only a submodule of a single transformer layer and yet reduces hallucination by 30%-40% across multiple short-form QA benchmarks. CASAL is 30x more compute-efficient and 20x more data-efficient than strong LoRA-based baselines such as SFT and DPO, boosting its practical applicability in data scarce domains. Importantly, CASAL also generalizes effectively to out-of-distribution (OOD) domains. We showcase CASAL's flexibility in mitigating hallucinations in both text-only and vision-language models. To our knowledge, CASAL is the first steering-based training method that has been shown to be effective for both dense and Mixture-of-Experts (MoE) models. CASAL represents a promising step forward for applying interpretability-inspired method for practical deployment in production systems.

大模型幻觉抑制激活调控轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。