arXiv:2608.13956cs.IR2026-08

研究检索结果冗余与多样性对RAG效果的影响,发现多样文档显著提升答案正确率。

How retriever redundancy and diversity impact RAG effectiveness

论文配图:How retriever redundancy and diversity impact RAG effectiveness
图 1 · 摘自论文原文
  • 对比重复、改写和多样化文档三种检索结果
  • 多样化文档使答案正确率提升17%至47%
  • 提升源于文档类型差异,而非更多相关答案

在RAG中,检索器通常按单个文档与查询的相关性排序,而生成器则基于所有检索到的文档整体生成答案。本文研究检索结果的冗余与多样性对生成器答案正确性的影响。以往研究结论不一:部分认为冗余能强化相关信息,另一些则认为大模型改写同一内容可能有益。但许多研究未控制如文档是否包含精确答案或参数化知识是否起作用等混杂因素。本研究通过精心设计的实验,考察三种检索文档集合情形:1)重复(同一文档的完全复制),2)改写(大模型重述的版本),3)多样化(来自不同文体的文档,各自以不同形式包含相关信息)。控制文档中答案是否为精确匹配或改写形式。使用FictionalQA这一合成虚构问答数据集进行评估,确保大模型无法凭先验知识回答问题,必须依赖检索文档。结果表明,重复冗余和大模型改写并未显著提升答案正确性;而提供多样化文档则大幅提高正确率,提升幅度达17%至47%。进一步分析显示,该提升主要由文档类型多样性(如新闻、博客等)驱动,而非因提供更多相关答案所致。研究结果提示,未来检索方法应更关注满足生成器对检索结果多样性的偏好。

原文摘要 · Abstract (English)

In RAG, while the retriever typically ranks documents by their individual relevance to the query, the generator instead produces an answer based on the retrieved documents as a whole. This paper investigates how redundancy and diversity from the retrieved document set impact the generator in terms of answer correctness. Previous work has provided a mix of findings: some showing that redundancy improves generation by reinforcing relevant information, others that LLM-based paraphrasing of the same content may be beneficial. Many of these studies did not control for confounding factors like whether the documents contained the exact answer or not, and if parametric knowledge plays a role. We conduct a carefully controlled experiment investigating three key scenarios of retrieved document sets: 1) Duplicate (exact copies of the same document), 2) Paraphrased (LLM rephrased versions of one document) and 3) Diverse (documents from different genres each containing relevant information in different forms). We control for which documents contain the answer in exact match or rephrased form. Evaluation is done with FictionalQA, a synthetic, fictional question-answer dataset that ensures the LLM generator prior knowledge cannot answer the question; the answer must come from retrieved documents. We show that duplicate redundancy and LLM paraphrasing does not significantly improve answer correctness. However, providing diverse documents is highly beneficial, improving answer correctness by 17%-47%. We further show this improvement is driven by diverse forms of document genre (news, blogs, etc.) alone and not a consequence of more relevant answer being available to generator. Our findings help to direct more attention to how new retrieval methods might improve RAG by catering to the generator preference for diversity in retrieval results.

RAG检索多样性生成质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。