让大模型在推理时主动使用检索内容,提升问答系统抗干扰能力
Injecting External Knowledge into the Reasoning Process Enhances Retrieval-Augmented Generation
- 把检索到的文本直接嵌入模型推理过程,引导其判断信息真伪
- 在4个数据集上平均提升12.3%准确率,对错误信息干扰抵抗力更强
- 适合做高可靠性问答、知识校验等需要严谨推理的任务
检索增强生成(RAG)通过引入外部知识提升大语言模型在知识密集型任务中的表现,但其效果常受低质量检索片段的干扰。为提升模型对噪声的鲁棒性,本文提出「段落注入」方法,将检索到的段落显式融入大模型的推理过程,使其能识别并抵抗噪声信息。在四种推理增强型大模型和四个事实问答数据集上进行实验,结果表明该方法显著提升整体RAG性能。在随机噪声(无关段落)和反事实噪声(误导性段落)两种设置下,段落注入均表现出更强的鲁棒性。控制实验进一步验证其能有效利用正确信息。结果表明,将检索内容融入推理过程是构建更可靠RAG系统的有效路径。代码已开源。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) has been widely adopted to augment large language models (LLMs) with external knowledge for knowledge-intensive tasks. However, its effectiveness is often undermined by the presence of noisy (i.e., low-quality) retrieved passages. Enhancing LLMs' robustness to such noise is critical for improving the reliability of RAG systems. Recent advances have equipped LLMs with strong reasoning and self-reflection capabilities, allowing them to identify and correct errors in their reasoning process. Inspired by this ability, we propose Passage Injection-a simple yet effective method that explicitly incorporates retrieved passages into LLMs' reasoning process, aiming to enhance the model's ability to recognize and resist noisy passages. We validate Passage Injection under general RAG settings using BM25 as the retriever. Experiments on four reasoning-enhanced LLMs across four factual QA datasets demonstrate that Passage Injection significantly improves overall RAG performance. Further analysis on two noisy retrieval settings-random noise, where the model is provided irrelevant passages, and counterfactual noise, where it is given misleading passages-shows that Passage Injection consistently improves robustness. Controlled experiments confirm that Passage Injection can also effectively leverage helpful passages. These findings suggest that incorporating passages in LLMs' reasoning process is a promising direction for building more robust RAG systems. The code can be found \href{here}{https://github.com/Trustworthy-Information-Access/Passage-Injection}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。