让AI根据问题自动选最佳问答流程,又准又省
MAO-ARAG: Multi-Agent Orchestration for Adaptive Retrieval-Augmented Generation
- 用多个智能体分工协作,动态组合问答步骤
- 在多个数据集上准确率高,延迟和成本可控
- 适合需要灵活应变的复杂问答场景
在问答系统中,检索增强生成(RAG)能有效提升回答准确率并减少幻觉。RAG架构包括单轮、迭代和推理型等不同形式,适用于不同类型的问题。由于真实问题复杂度差异大,固定流程难以兼顾性能与成本。为此,我们提出基于多智能体编排的自适应RAG框架MAO-ARAG。该框架采用多轮设计,定义多个执行智能体(如查询重写、文档选择、生成等),由规划智能体根据问题动态选择并组合合适的工作流。每轮中,规划智能体通过强化学习训练,以F1分数为奖励、成本为惩罚,持续优化答案质量与资源消耗平衡。在多个QA数据集上的实验表明,该方法能为每条问题动态定制高效工作流,在保证高准确率的同时,将成本与延迟控制在可接受范围内。
原文摘要 · Abstract (English)
In question-answering (QA) systems, Retrieval-Augmented Generation (RAG) has become pivotal in enhancing response accuracy and reducing hallucination issues. The architecture of RAG systems varies significantly, encompassing single-round RAG, iterative RAG, and reasoning RAG, each tailored to address different types of queries. Due to the varying complexity of real-world queries, a fixed RAG pipeline often struggles to balance performance and cost efficiency across different queries. To address this challenge, we propose an adaptive RAG framework called MAO-ARAG, which leverages multi-agent orchestration. Our adaptive RAG is conceived as a multi-turn framework. Specifically, we define multiple executor agents, representing typical RAG modules such as query reformulation agents, document selection agent, and generation agents. A planner agent intelligently selects and integrates the appropriate agents from these executors into a suitable workflow tailored for each query, striving for high-quality answers while maintaining reasonable costs. During each turn, the planner agent is trained using reinforcement learning, guided by an outcome-based reward (F1 score) and a cost-based penalty, continuously improving answer quality while keeping costs within a reasonable range. Experiments conducted on multiple QA datasets demonstrate that our approach, which dynamically plans workflows for each query, not only achieves high answer quality but also maintains both cost and latency within acceptable limits.The code of MAO-ARAG is on https://github.com/chenyiqun/Agentic-RAG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。