用图记忆增强的智能路由,让多个AI Agent协作更高效准确。
GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs

- 构建异构图记忆网络,动态选择LLM和角色生成任务流程。
- 准确率最高提升9.3%,显存消耗从186.26 GiB降至1.04 GiB。
- 支持未见过的任务与模型,适合复杂多轮协作场景。
LLM路由在融合多种模型优势的同时兼顾效率与性能方面已取得显著进展。然而,为支持更真实复杂的应用,路由需扩展至代理型LLM环境,其中任务规划、异构代理间的多轮协作及记忆利用不可或缺。为此,我们提出GraphPlanner,一种面向多代理LLM的异构图记忆增强型代理路由机制,可为每个查询生成路由工作流,并支持归纳与直推推理。GraphPlanner将工作流生成建模为马尔可夫决策过程(MDP),每一步同时选择LLM主干与代理角色(如规划者、执行者、总结者)。通过异构图GARNet捕捉查询、代理与响应间的交互记忆,将历史记忆与工作流记忆融入更丰富的状态表示。整个流程采用强化学习联合优化,提升任务性能与计算效率。我们在14个多样化LLM任务上评估GraphPlanner,结果表明:(1) 相比强大多轮与单轮路由器,其准确率最高提升9.3%,显存使用从186.26 GiB降至1.04 GiB;(2) 对未见任务与模型具有强零样本泛化能力;(3) 有效利用历史记忆,支持归纳与直推推理,实现更自适应的路由。代码已开源:https://github.com/ulab-uiuc/GraphPlanner。
原文摘要 · Abstract (English)
LLM routing has achieved promising results in integrating the strengths of diverse models while balancing efficiency and performance. However, to support more realistic and challenging applications, routing must extend into agentic LLM settings, where task planning, multi-round cooperation among heterogeneous agents, and memory utilization are indispensable. To address this gap, we propose GraphPlanner, a heterogeneous graph memory-augmented agentic router for multi-agent LLMs that generates routing workflows for each query and supports both inductive and transductive inference. GraphPlanner formulates workflow generation as a Markov Decision Process (MDP), where at each step it selects both the LLM backbone and the agent role, including Planner, Executor, and Summarizer. By leveraging a heterogeneous graph, denoted as GARNet, to capture interaction memories among queries, agents, and responses, GraphPlanner integrates historical memory and workflow memory into richer state representations. The entire pipeline is optimized with reinforcement learning, jointly improving task-specific performance and computational efficiency. We evaluate GraphPlanner across 14 diverse LLM tasks and demonstrate that: (1) GraphPlanner outperforms strong single-round and multi-round routers, improving accuracy by up to 9.3% while reducing GPU cost from 186.26 GiB to 1.04 GiB; (2) GraphPlanner generalizes robustly to unseen tasks and LLMs, exhibiting strong zero-shot capabilities; and (3) GraphPlanner effectively leverages historical memories, supporting both inductive and transductive inference for more adaptive routing. Our code for GraphPlanner is released at https://github.com/ulab-uiuc/GraphPlanner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。