arXiv:2502.15543cs.CLcs.AI2025-02NeurIPS被引 10

抑制模型内部关键神经元,让大模型更听外部证据的话。

ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation

  • 识别并压制导致错误生成的深层前馈网络神经元
  • 在新基准上使幻觉率降低41.2%,依赖内部记忆减少63%
  • 适合关注大模型可信生成、RAG系统优化的研究者

将大语言模型与检索增强生成(RAG)结合可提升事实准确性,但模型仍易产生与外部证据矛盾的不忠实输出。现有方法多聚焦于强化外部信息利用,却忽视了内部参数化知识在生成过程中的持续影响。本文通过分析发现,部分中深层前馈网络(FFNs)在不忠实生成时被过度激活。基于此提出ParamMute框架,通过抑制这些关联不忠实的FFN激活,引导模型更依赖检索到的知识。为评估该方法,构建了CoFaithfulQA基准,用于测试内部知识与外部证据冲突时的忠实性。实验表明,ParamMute在CoFaithfulQA和ConFiQA上均显著提升忠实性,对参数化记忆的依赖降低63%,有效缓解内部知识主导问题,为提升RAG系统可信度提供新方向。代码已开源。

原文摘要 · Abstract (English)

Large language models (LLMs) integrated with retrieval-augmented generation (RAG) have improved factuality by grounding outputs in external evidence. However, they remain susceptible to unfaithful generation, where outputs contradict retrieved context despite its relevance and accuracy. Existing approaches aiming to improve faithfulness primarily focus on enhancing the utilization of external context, but often overlook the persistent influence of internal parametric knowledge during generation. In this work, we investigate the internal mechanisms behind unfaithful generation and identify a subset of mid-to-deep feed-forward networks (FFNs) that are disproportionately activated in such cases. Building on this insight, we propose Parametric Knowledge Muting through FFN Suppression (ParamMute), a framework that improves contextual faithfulness by suppressing the activation of unfaithfulness-associated FFNs and calibrating the model toward retrieved knowledge. To evaluate our approach, we introduce CoFaithfulQA, a benchmark specifically designed to evaluate faithfulness in scenarios where internal knowledge conflicts with accurate external evidence. Experimental results show that ParamMute significantly enhances faithfulness across both CoFaithfulQA and the established ConFiQA benchmark, achieving substantial reductions in reliance on parametric memory. These findings underscore the importance of mitigating internal knowledge dominance and provide a new direction for improving LLM trustworthiness in RAG. All codes are available at https://github.com/OpenBMB/ParamMute.

RAG可信生成模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。