用多智能体协作让大模型精准推理超千节点图,无需微调。
Scalable and Accurate Graph Reasoning with LLM-based Multi-Agents
- 将图任务拆解为节点级任务,由多个智能体协同解决。
- 在1000+节点图上实现接近完美的准确率,远超现有模型。
- 适合需要高精度图推理的现实应用,如网页重要性分析。
近期研究探索了利用大语言模型(LLMs)解决复杂图推理任务。然而,由于图结构的复杂性以及LLM处理长文本的固有局限,现有方法即使在小规模图和简单任务上也难以达到满意准确率。为此,我们提出GraphAgent-Reasoner,一种无需微调的多智能体协作框架,用于显式且精确的图推理。受分布式图计算理论启发,该框架将图问题分解为更小的、以节点为中心的任务,并分配给多个智能体。智能体协同求解整体问题,显著降低单个LLM需处理的信息量与复杂度,从而提升图推理准确率。通过简单增加智能体数量,GraphAgent-Reasoner可高效扩展至超过1000个节点的大图。在GraphInstruct数据集上的评估显示,该框架在多项式时间图推理任务上达到接近完美的准确率,显著优于当前最佳的闭源及微调开源模型。此外,该框架还具备处理真实世界图推理应用的能力,例如网页重要性分析。
原文摘要 · Abstract (English)
Recent research has explored the use of Large Language Models (LLMs) for tackling complex graph reasoning tasks. However, due to the intricacies of graph structures and the inherent limitations of LLMs in handling long text, current approaches often fail to deliver satisfactory accuracy, even on small-scale graphs and simple tasks. To address these challenges, we introduce GraphAgent-Reasoner, a fine-tuning-free framework that utilizes a multi-agent collaboration strategy for explicit and precise graph reasoning. Inspired by distributed graph computation theory, our framework decomposes graph problems into smaller, node-centric tasks that are distributed among multiple agents. The agents collaborate to solve the overall problem, significantly reducing the amount of information and complexity handled by a single LLM, thus enhancing the accuracy of graph reasoning. By simply increasing the number of agents, GraphAgent-Reasoner can efficiently scale to accommodate larger graphs with over 1,000 nodes. Evaluated on the GraphInstruct dataset, our framework demonstrates near-perfect accuracy on polynomial-time graph reasoning tasks, significantly outperforming the best available models, both closed-source and fine-tuned open-source variants. Our framework also demonstrates the capability to handle real-world graph reasoning applications such as webpage importance analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。