用模型自知知识筛选检索内容,减少幻觉并提升问答质量
SKILL-RAG: Self-Knowledge Induced Learning and Filtering for Retrieval-Augmented Generation
- 通过强化学习挖掘模型自身知识,判断检索内容是否相关
- 在多个基准上降低输入文档数,同时提升生成质量
- 适合需要高精度知识问答的场景,如智能客服、科研助手
检索增强生成(RAG)近年来显著提升了大语言模型在知识密集型任务中的表现。然而,检索系统可能返回无关内容,将其引入模型常导致幻觉。因此,识别并过滤无用检索内容是提升RAG性能的关键挑战。为更好融合模型内部知识与外部检索知识,需明确模型“已知”与“未知”(即“自知”)。基于此,我们提出SKILL-RAG(Self-Knowledge Induced Learning and Filtering for RAG),一种利用模型自知知识判断检索文档是否有助于回答问题的新方法。该方法设计基于强化学习的训练框架,显式激发模型自知,并以句子级粒度过滤无关内容,同时保留有用知识。我们在Llama2-7B和Qwen3-8B上对多个问答基准进行评估,结果表明SKILL-RAG不仅提升生成质量,还显著减少输入文档数量,验证了自知知识在引导高质量检索选择中的重要性。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has significantly improved the performance of large language models (LLMs) on knowledge-intensive tasks in recent years. However, since retrieval systems may return irrelevant content, incorporating such information into the model often leads to hallucinations. Thus, identifying and filtering out unhelpful retrieved content is a key challenge for improving RAG performance.To better integrate the internal knowledge of the model with external knowledge from retrieval, it is essential to understand what the model "knows" and "does not know" (which is also called "self-knowledge"). Based on this insight, we propose SKILL-RAG (Self-Knowledge Induced Learning and Filtering for RAG), a novel method that leverages the model's self-knowledge to determine which retrieved documents are beneficial for answering a given query. We design a reinforcement learning-based training framework to explicitly elicit self-knowledge from the model and employs sentence-level granularity to filter out irrelevant content while preserving useful knowledge.We evaluate SKILL-RAG using Llama2-7B and Qwen3-8B on several question answering benchmarks. Experimental results demonstrate that SKILL-RAG not only improves generation quality but also significantly reduces the number of input documents, validating the importance of self-knowledge in guiding the selection of high-quality retrievals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。