arXiv:2504.13079cs.CLcs.AI2025-04被引 82

让AI通过多智能体辩论,同时处理模糊问题和矛盾信息。

Retrieval-Augmented Generation with Conflicting Evidence

  • 用多智能体辩论机制,自动筛选真实信息并排除噪声。
  • 在复杂数据集上,准确率比现有方法最高提升15.8%。
  • 适合需要高可靠性的问答系统开发者使用。

大型语言模型代理正越来越多地采用检索增强生成(RAG)以提升回答的事实性。然而,在实际应用中,系统常需应对用户查询的模糊性及来自多源的矛盾信息,同时抑制噪声或无关文档中的错误信息。以往研究通常孤立处理这些问题,如仅关注模糊性或对噪声的鲁棒性。本文首次同时考虑多种因素,提出(i)RAMDocs数据集,模拟包含模糊性、虚假信息和噪声的复杂现实场景;(ii)MADAM-RAG多智能体方法,通过多轮辩论让代理协作识别实体歧义、合并有效答案并剔除虚假信息。实验表明,在AmbigDocs任务(需呈现所有有效答案)上,相比强基线最高提升11.40%;在FaithEval任务(需抑制虚假信息)上,使用Llama3.3-70B-Instruct时最高提升15.80%(绝对值)。此外,现有RAG基线在RAMDocs上仅获32.60%精确匹配分,而MADAM-RAG虽有改进,但在支持证据与虚假信息严重失衡时仍存在显著差距。

原文摘要 · Abstract (English)

Large language model (LLM) agents are increasingly employing retrieval-augmented generation (RAG) to improve the factuality of their responses. However, in practice, these systems often need to handle ambiguous user queries and potentially conflicting information from multiple sources while also suppressing inaccurate information from noisy or irrelevant documents. Prior work has generally studied and addressed these challenges in isolation, considering only one aspect at a time, such as handling ambiguity or robustness to noise and misinformation. We instead consider multiple factors simultaneously, proposing (i) RAMDocs (Retrieval with Ambiguity and Misinformation in Documents), a new dataset that simulates complex and realistic scenarios for conflicting evidence for a user query, including ambiguity, misinformation, and noise; and (ii) MADAM-RAG, a multi-agent approach in which LLM agents debate over the merits of an answer over multiple rounds, allowing an aggregator to collate responses corresponding to disambiguated entities while discarding misinformation and noise, thereby handling diverse sources of conflict jointly. We demonstrate the effectiveness of MADAM-RAG using both closed and open-source models on AmbigDocs -- which requires presenting all valid answers for ambiguous queries -- improving over strong RAG baselines by up to 11.40% and on FaithEval -- which requires suppressing misinformation -- where we improve by up to 15.80% (absolute) with Llama3.3-70B-Instruct. Furthermore, we find that RAMDocs poses a challenge for existing RAG baselines (Llama3.3-70B-Instruct only obtains 32.60 exact match score). While MADAM-RAG begins to address these conflicting factors, our analysis indicates that a substantial gap remains especially when increasing the level of imbalance in supporting evidence and misinformation.

RAG多智能体事实性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。