arXiv:2509.12765cs.IRcs.AI2025-09EMNLP被引 12

用信息增益重排文档,让大模型生成更准。

InfoGain-RAG: Boosting Retrieval-Augmented Generation via Document Information Gain-based Reranking and Filtering

  • 用LLM生成置信度差值衡量文档贡献度
  • 在NaturalQA上比基线高17.9%准确率
  • 适合需要精准问答的场景

检索增强生成(RAG)虽能缓解大语言模型的幻觉、知识过时等问题,但现有框架难以判断检索文档是否对答案生成有实际贡献。本文提出文档信息增益(DIG),通过计算加入文档前后大模型生成置信度的差异来量化其价值。基于DIG分数,我们构建InfoGain-RAG框架,训练专用重排序器,从精确区分和准确排序角度筛选最有价值的文档。在多个模型与基准测试中,该方法显著优于现有方案:在NaturalQA上,相比朴素RAG、自反思RAG和现代排名型RAG,精确匹配准确率分别提升17.9%、4.5%和12.5%;在GPT-4o上,所有数据集平均提升15.3%。结果证明,InfoGain-RAG可为多种应用提供可靠的RAG解决方案。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) has emerged as a promising approach to address key limitations of Large Language Models (LLMs), such as hallucination, outdated knowledge, and lacking reference. However, current RAG frameworks often struggle with identifying whether retrieved documents meaningfully contribute to answer generation. This shortcoming makes it difficult to filter out irrelevant or even misleading content, which notably impacts the final performance. In this paper, we propose Document Information Gain (DIG), a novel metric designed to quantify the contribution of retrieved documents to correct answer generation. DIG measures a document's value by computing the difference of LLM's generation confidence with and without the document augmented. Further, we introduce InfoGain-RAG, a framework that leverages DIG scores to train a specialized reranker, which prioritizes each retrieved document from exact distinguishing and accurate sorting perspectives. This approach can effectively filter out irrelevant documents and select the most valuable ones for better answer generation. Extensive experiments across various models and benchmarks demonstrate that InfoGain-RAG can significantly outperform existing approaches, on both single and multiple retrievers paradigm. Specifically on NaturalQA, it achieves the improvements of 17.9%, 4.5%, 12.5% in exact match accuracy against naive RAG, self-reflective RAG and modern ranking-based RAG respectively, and even an average of 15.3% increment on advanced proprietary model GPT-4o across all datasets. These results demonstrate the feasibility of InfoGain-RAG as it can offer a reliable solution for RAG in multiple applications.

RAG信息增益问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。