arXiv:2511.04700cs.CLcs.AI2025-11EMNLP被引 2

通过分阶段筛选冗余文档,提升检索增强生成的准确性。

Separate the Wheat from the Chaff: Winnowing Down Divergent Views in Retrieval Augmented Generation

  • 先聚类相似文档,再让多个代理生成答案,实现精准分工。
  • 用批判性大模型迭代筛选,保留有用信息,丢弃噪声文档。
  • 无需微调,兼容多种模型,适合需要高可靠性的问答任务。

检索增强生成(RAG)通过引入外部知识源来弥补大语言模型在获取最新或专业信息方面的不足。扩大检索文档数量虽可能提高相关文档的命中率,但也会引入大量无关或误导性内容,降低生成结果的整体准确性。为解决这一问题,我们提出WinnowRAG框架,通过系统性地筛选噪声文档并保留有价值内容,实现‘去芜存菁’。该框架分为两阶段:第一阶段进行查询感知聚类,将相似文档分组并分配给不同的LLM代理生成独立回答;第二阶段执行‘筛除’操作,由一个批判性LLM评估各代理输出,并迭代分离出有用文档与噪声。为避免丢弃有效代理时损失知识,我们提出两种策略性合并技术,确保最终生成仅基于相关知识。关键的是,WinnowRAG具备模型无关性,无需任何微调,可广泛适配各类任务。在多个真实数据集上的实验表明,其性能显著优于现有先进方法。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources to address their limitations in accessing up-to-date or specialized information. A natural strategy to increase the likelihood of retrieving relevant information is to expand the number of retrieved documents. However, involving more documents could introduce significant noise, as many documents may be irrelevant or misleading, thereby reducing the overall accuracy of the generated responses. To overcome the challenge associated with handling a larger number of documents, we propose WinnowRAG, a novel RAG framework designed to systematically filter out noisy documents while preserving valuable content -- a process we refer to as winnowing. WinnowRAG operates in two stages: In Stage I, we perform query-aware clustering to group similar documents and form distinct topic clusters. Each cluster is assigned to an LLM agent for generating a unique answer. In Stage II, we perform winnowing, wherein a critic LLM evaluates the outputs of multiple agents and iteratively separates useful documents from noisy ones. To retain useful documents when discarding agents, we propose two strategic merging techniques to ensure that only relevant knowledge is used for generating the final response. Crucially, WinnowRAG is model-agnostic and does not require any model fine-tuning, making it easily adaptable to various tasks. Extensive experiments on various realistic datasets demonstrate the effectiveness of WinnowRAG over state-of-the-art baselines.

RAG信息筛选大模型知识增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。