arXiv:2502.06205cs.CLcs.AI2025-02ICML被引 10

让检索与生成模型像人一样反复试错,提升问答准确率。

C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Generation

  • 用三个轻量级代理协同优化检索与生成流程
  • 在多个数据集上将准确率提升12%-18%且无需修改原有模型
  • 适合希望不改动现有系统却提升性能的研究者

检索增强生成(RAG)系统面临检索器与大语言模型(LLM)独立开发导致的对齐难题。现有方法通常需修改任一组件或引入简单中间模块,存在实用性限制且性能欠佳。受人类搜索行为启发——即不断提出查询并查阅文档,我们提出C-3PO:一种以代理为中心的框架,通过轻量级多智能体系统促进检索器与LLM之间的沟通。该框架包含三个专用智能体,协作优化整个RAG流程,而无需修改原始检索器和LLM。这些智能体共同判断是否需要检索、生成有效查询,并筛选适配LLM的信息。为实现高效多智能体协调,我们设计了一种树状展开策略,用于强化学习中的奖励分配。在域内与域外场景的大量实验表明,C-3PO显著提升了RAG性能,同时保持即插即用的灵活性和出色的泛化能力。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) systems face a fundamental challenge in aligning independently developed retrievers and large language models (LLMs). Existing approaches typically involve modifying either component or introducing simple intermediate modules, resulting in practical limitations and sub-optimal performance. Inspired by human search behavior -- typically involving a back-and-forth process of proposing search queries and reviewing documents, we propose C-3PO, a proxy-centric framework that facilitates communication between retrievers and LLMs through a lightweight multi-agent system. Our framework implements three specialized agents that collaboratively optimize the entire RAG pipeline without altering the retriever and LLMs. These agents work together to assess the need for retrieval, generate effective queries, and select information suitable for the LLMs. To enable effective multi-agent coordination, we develop a tree-structured rollout approach for reward credit assignment in reinforcement learning. Extensive experiments in both in-domain and out-of-distribution scenarios demonstrate that C-3PO significantly enhances RAG performance while maintaining plug-and-play flexibility and superior generalization capabilities.

检索增强多智能体生成优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。