arXiv:2508.12379cs.AI2025-08被引 15

用多智能体协作突破大模型图推理的内存瓶颈

GraphCogent: Mitigating LLMs' Working Memory Constraints via Multi-Agent Collaboration in Complex Graph Understanding

  • 设计三模块协同框架,模拟人类工作记忆分解图推理任务
  • 在10倍更大规模图上实现50%性能提升,优于671B参数大模型
  • 适合处理真实世界复杂图数据,如社交、交通网络等场景

大型语言模型(LLMs)在小规模图推理任务中表现良好,但在处理现实世界复杂图时失败,根源在于其工作记忆限制,难以在长上下文保持远距离图结构并持续进行多步推理。现实世界图结构复杂,涵盖网页、交通、社交和引文网络。为此,我们提出GraphCogent,一个受人类工作记忆模型启发的多智能体协作框架,将图推理分解为感知、缓冲和执行三个认知过程。该框架包含三个模块:感知模块通过子图采样统一多样化图文本表示;缓冲模块跨多种格式整合并索引图数据;执行模块结合工具调用与工具创建实现高效推理。我们还构建了Graph4real基准,覆盖网页、交通、社交和引文四类真实世界图数据,包含21个不同图推理任务,分为结构查询、算法推理和预测建模三类,图规模达现有基准的10倍。实验表明,基于Llama3.1-8B的GraphCogent相比DeepSeek-R1(671B)提升50%;相较于最先进代理基线,在工具集内任务中准确率提高20%,令牌消耗降低80%;在工具集外任务中令牌消耗降低30%。代码将在评审后公开。

原文摘要 · Abstract (English)

Large language models (LLMs) show promising performance on small-scale graph reasoning tasks but fail when handling real-world graphs with complex queries. This phenomenon arises from LLMs' working memory constraints, which result in their inability to retain long-range graph topology over extended contexts while sustaining coherent multi-step reasoning. However, real-world graphs are often structurally complex, such as Web, Transportation, Social, and Citation networks. To address these limitations, we propose GraphCogent, a collaborative agent framework inspired by human Working Memory Model that decomposes graph reasoning into specialized cognitive processes: sense, buffer, and execute. The framework consists of three modules: Sensory Module standardizes diverse graph text representations via subgraph sampling, Buffer Module integrates and indexes graph data across multiple formats, and Execution Module combines tool calling and tool creation for efficient reasoning. We also introduce Graph4real, a comprehensive benchmark that contains four domains of real-world graphs (Web, Transportation, Social, and Citation) to evaluate LLMs' graph reasoning capabilities. Our Graph4real covers 21 different graph reasoning tasks, categorized into three types (Structural Querying, Algorithmic Reasoning, and Predictive Modeling tasks), with graph scales up to 10 times larger than existing benchmarks. Experiments show that Llama3.1-8B based GraphCogent achieves a 50% improvement over massive-scale LLMs like DeepSeek-R1 (671B). Compared to state-of-the-art agent-based baseline, our framework outperforms by 20% in accuracy while reducing token usage by 80% for in-toolset tasks and 30% for out-toolset tasks. Code will be available after review.

图神经网络多智能体大模型推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。