arXiv:2510.22344cs.CLcs.AI2025-10被引 7

通过逐轮补缺证据,让大模型问答更准更可信。

FAIR-RAG: Faithful Adaptive Iterative Refinement for Retrieval-Augmented Generation

  • 用结构化评估机制识别信息缺口,驱动精准追问
  • 在多跳问答上提升8.3点F1,刷新最佳性能纪录
  • 适合需要严谨推理的复杂知识任务,如科研检索

尽管检索增强生成(RAG)能缓解大模型的幻觉和知识陈旧问题,但现有框架在处理需整合多源信息的复杂多跳查询时表现不佳。当前先进RAG方法虽采用迭代或自适应策略,却缺乏系统性识别与填补证据空缺的机制,常传播噪声或无法获取完整上下文。我们提出FAIR-RAG,一种新型代理式框架,将标准RAG流程转化为动态、以证据为导向的推理过程。核心是受结构化证据评估(SEA)模块控制的迭代优化循环。SEA作为分析型门控机制,将初始查询拆解为待验证要点清单,并审查已聚合证据以识别已确认事实及关键信息缺口。这些缺口为自适应查询优化代理提供精确信号,生成针对性子查询以获取缺失信息。该循环持续进行,直至证据被验证充分,确保最终生成严格忠实于证据。我们在多个挑战性多跳问答基准测试中进行了实验,包括HotpotQA、2WikiMultiHopQA和MusiQue。在统一实验设置下,FAIR-RAG显著优于强基线,在HotpotQA上达到0.453的F1分数,较最强迭代基线绝对提升8.3点,成为此类方法的新标杆。结果表明,具备显式缺口分析的结构化、证据驱动优化过程对实现高级RAG系统在复杂知识密集型任务中的可靠准确推理至关重要。

原文摘要 · Abstract (English)

While Retrieval-Augmented Generation (RAG) mitigates hallucination and knowledge staleness in Large Language Models (LLMs), existing frameworks often falter on complex, multi-hop queries that require synthesizing information from disparate sources. Current advanced RAG methods, employing iterative or adaptive strategies, lack a robust mechanism to systematically identify and fill evidence gaps, often propagating noise or failing to gather a comprehensive context. We introduce FAIR-RAG, a novel agentic framework that transforms the standard RAG pipeline into a dynamic, evidence-driven reasoning process. At its core is an Iterative Refinement Cycle governed by a module we term Structured Evidence Assessment (SEA). The SEA acts as an analytical gating mechanism: it deconstructs the initial query into a checklist of required findings and audits the aggregated evidence to identify confirmed facts and, critically, explicit informational gaps. These gaps provide a precise signal to an Adaptive Query Refinement agent, which generates new, targeted sub-queries to retrieve missing information. This cycle repeats until the evidence is verified as sufficient, ensuring a comprehensive context for a final, strictly faithful generation. We conducted experiments on challenging multi-hop QA benchmarks, including HotpotQA, 2WikiMultiHopQA, and MusiQue. In a unified experimental setup, FAIR-RAG significantly outperforms strong baselines. On HotpotQA, it achieves an F1-score of 0.453 -- an absolute improvement of 8.3 points over the strongest iterative baseline -- establishing a new state-of-the-art for this class of methods on these benchmarks. Our work demonstrates that a structured, evidence-driven refinement process with explicit gap analysis is crucial for unlocking reliable and accurate reasoning in advanced RAG systems for complex, knowledge-intensive tasks.

RAG多跳推理生成可信度智能检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。