用多个AI代理协作分析图数据,准确率提升超两成。
GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration
- 设计五名各有专长的AI代理,模拟人类协作解题。
- 在六个图分析任务上平均准确率比基线高25.85%。
- 适合需要跨领域推理与复杂图分析的研究者。
图广泛用于建模现实中的关系数据,如社交网络和城市计算。现有基于大语言模型(LLM)的图分析方法要么融合图神经网络(GNNs)用于特定任务,限制了迁移性;要么仅依赖LLM内部推理能力,导致性能不佳。为解决这些问题,我们利用近期LLM代理的进展,其具备调用外部知识或工具解决问题的能力。受人类类比与协作思维启发,提出基于LLM的多代理系统GraphTeam,用于图分析。GraphTeam包含来自三个模块的五个LLM代理:(1)输入输出归一化模块:问题代理从原始问题中提取并精炼四个关键参数,提升问题理解;答案代理按输出需求组织结果;(2)外部知识检索模块:构建包含相关文档与经验信息的知识库,搜索代理为每个问题检索最相关条目;(3)问题求解模块:给定搜索代理提供的信息,编码代理通过编程实现已有算法生成解决方案;若编码代理失败,则推理代理直接计算结果。在六个图分析基准上的实验表明,GraphTeam在准确率上平均比最佳基线提升25.85%,达到当前最优水平。代码与数据见https://github.com/BUPT-GAMMA/GraphTeam。
原文摘要 · Abstract (English)
Graphs are widely used for modeling relational data in real-world scenarios, such as social networks and urban computing. Existing LLM-based graph analysis approaches either integrate graph neural networks (GNNs) for specific machine learning tasks, limiting their transferability, or rely solely on LLMs' internal reasoning ability, resulting in suboptimal performance. To address these limitations, we take advantage of recent advances in LLM-based agents, which have shown capabilities of utilizing external knowledge or tools for problem solving. By simulating human problem-solving strategies such as analogy and collaboration, we propose a multi-agent system based on LLMs named GraphTeam, for graph analysis. GraphTeam consists of five LLM-based agents from three modules, and the agents with different specialities can collaborate with each other to address complex problems. Specifically, (1) input-output normalization module: the question agent extracts and refines four key arguments from the original question, facilitating the problem understanding, and the answer agent organizes the results to meet the output requirement; (2) external knowledge retrieval module: we first build a knowledge base consisting of relevant documentation and experience information, and then the search agent retrieves the most relevant entries for each question. (3) problem-solving module: given the retrieved information from search agent, the coding agent uses established algorithms via programming to generate solutions, and in case the coding agent does not work, the reasoning agent will directly compute the results without programming. Extensive experiments on six graph analysis benchmarks demonstrate that GraphTeam achieves state-of-the-art performance with an average 25.85% improvement over the best baseline in terms of accuracy. The code and data are available at https://github.com/BUPT-GAMMA/GraphTeam.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。