arXiv:2506.07398cs.MAcs.CL2025-06NeurIPS被引 87

为多智能体系统设计分层记忆架构,提升协作与自我进化能力。

G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems

  • 构建三层图结构记忆:洞察、查询、交互图,追踪协作轨迹。
  • 在五个基准上提升任务成功率20.89%、知识问答准确率10.12%。
  • 适用于需要长期协作的复杂任务,如多智能体规划与执行。

基于大语言模型的多智能体系统虽展现出超越单智能体的认知与执行能力,但其自我演化能力受限于薄弱的记忆架构。现有机制存在两大缺陷:一是过于简单,忽略智能体间协作路径的细微差异;二是缺乏跨轮次与个体定制化,远逊于单智能体的表达性记忆。为此,我们提出G-Memory,一种受组织记忆理论启发的分层智能体记忆系统,通过三层图结构(洞察图、查询图、交互图)管理长期多智能体交互。当接收新用户请求时,G-Memory双向遍历记忆,检索可泛化的高层洞察与紧凑编码的精细协作轨迹。任务执行后,整个层级通过融合新协作路径动态演化,促进智能体团队的渐进式进化。在五个基准、三种LLM骨干和三种主流多智能体框架上的实验表明,G-Memory在具身动作任务中成功率提升最高达20.89%,知识问答准确率提升最高达10.12%,且无需修改原有框架。代码已开源。

原文摘要 · Abstract (English)

Large language model (LLM)-powered multi-agent systems (MAS) have demonstrated cognitive and execution capabilities that far exceed those of single LLM agents, yet their capacity for self-evolution remains hampered by underdeveloped memory architectures. Upon close inspection, we are alarmed to discover that prevailing MAS memory mechanisms (1) are overly simplistic, completely disregarding the nuanced inter-agent collaboration trajectories, and (2) lack cross-trial and agent-specific customization, in stark contrast to the expressive memory developed for single agents. To bridge this gap, we introduce G-Memory, a hierarchical, agentic memory system for MAS inspired by organizational memory theory, which manages the lengthy MAS interaction via a three-tier graph hierarchy: insight, query, and interaction graphs. Upon receiving a new user query, G-Memory performs bi-directional memory traversal to retrieve both $\textit{high-level, generalizable insights}$ that enable the system to leverage cross-trial knowledge, and $\textit{fine-grained, condensed interaction trajectories}$ that compactly encode prior collaboration experiences. Upon task execution, the entire hierarchy evolves by assimilating new collaborative trajectories, nurturing the progressive evolution of agent teams. Extensive experiments across five benchmarks, three LLM backbones, and three popular MAS frameworks demonstrate that G-Memory improves success rates in embodied action and accuracy in knowledge QA by up to $20.89\%$ and $10.12\%$, respectively, without any modifications to the original frameworks. Our codes are available at https://github.com/bingreeky/GMemory.

多智能体记忆机制分层图协作演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。