用双智能体框架让RAG检索更准、推理更可解释。
SIRAG: Towards Stable and Interpretable RAG with A Process-Supervised Multi-Agent Framework
- 引入决策者和知识筛选者两个轻量级智能体协调检索与生成。
- 在多跳问答上准确率提升,收敛更稳定,推理路径更清晰。
- 无需改动现有组件,可直接接入实际应用,适合工程落地。
检索增强生成(RAG)使大语言模型能访问外部知识,但其效果依赖于检索器与生成器的协同。由于两者独立开发,交互常不理想:检索器可能返回无关或冗余文档,生成器则未能充分利用检索证据。本文提出一种过程监督的多智能体框架,引入两个轻量级智能体——决策者决定何时继续检索或停止生成答案,知识筛选者过滤文档仅保留最相关证据。通过一个以LLM为裁判的机制,对每一步中间动作进行细粒度过程奖励评估,实现比仅依据最终答案正确性更精准的信用分配。进一步采用树状回溯策略探索多样推理路径,并使用近端策略优化(PPO)端到端训练两个智能体。在单跳与多跳问答基准测试中,该方法相比标准RAG基线达到更高准确率、更稳定的收敛表现,并生成更具可解释性的推理轨迹。重要的是,该框架模块化且即插即用,无需修改原有检索器或生成器,适用于真实世界RAG应用。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are developed independently, their interaction is often suboptimal: the retriever may return irrelevant or redundant documents, while the generator may fail to fully leverage retrieved evidence. In this work, we propose a process-supervised multi-agent framework to bridge the gap between retriever and generator. The framework introduces two lightweight agents: a Decision Maker, which determines when to continue retrieval or stop for answer generation, and a Knowledge Selector, which filters retrieved documents to retain only the most useful evidence. To provide fine-grained supervision, we employ an LLM-as-a-Judge that evaluates each intermediate action with process-level rewards, ensuring more accurate credit assignment than relying solely on final answer correctness. We further adopt a tree-structured rollout strategy to explore diverse reasoning paths, and train both agents with Proximal Policy Optimization (PPO) in an end-to-end manner. Experiments on single-hop and multi-hop question answering benchmarks show that our approach achieves higher accuracy, more stable convergence, and produces more interpretable reasoning trajectories compared with standard RAG baselines. Importantly, the proposed framework is modular and plug-and-play, requiring no modification to the retriever or generator, making it practical for real-world RAG applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。