arXiv:2503.03258cs.LGcs.AI2025-03被引 3

用大模型预测动态图,突破了传统静态图限制。

Exploring the Potential of Large Language Models as Predictors in Dynamic Text-Attributed Graphs

  • 设计多智能体框架,分层处理全局与局部知识
  • 在无微调情况下性能媲美甚至超过监督图神经网络
  • 适合需要跨领域泛化的动态图预测任务

随着大语言模型(LLMs)的发展,图基础模型(GFMs)在图任务中展现出强大泛化能力。然而,现有研究主要聚焦于静态图,忽视了动态图预测的潜力。本文首次探索将LLMs用于动态图预测,识别出两大挑战:上下文长度限制导致难以处理大规模历史数据,以及领域特征差异大,难以构建统一预测器。为此,提出GraphAgent-Dynamic(GAD)框架,采用多智能体协作机制,引入全局与局部摘要智能体生成领域特定知识,提升跨域迁移能力;并通过知识反思智能体实现自适应更新,保持架构一致性。实验表明,GAD在无需特定数据集训练的情况下,性能可媲美甚至超越全监督图神经网络。最后,讨论通过数据集微调等策略进一步提升任务表现,为未来基于大模型的预测器设计提供新思路。

原文摘要 · Abstract (English)

With the rise of large language models (LLMs), there has been growing interest in Graph Foundation Models (GFMs) for graph-based tasks. By leveraging LLMs as predictors, GFMs have demonstrated impressive generalizability across various tasks and datasets. However, existing research on LLMs as predictors has predominantly focused on static graphs, leaving their potential in dynamic graph prediction unexplored. In this work, we pioneer using LLMs for predictive tasks on dynamic graphs. We identify two key challenges: the constraints imposed by context length when processing large-scale historical data and the significant variability in domain characteristics, both of which complicate the development of a unified predictor. To address these challenges, we propose the GraphAgent-Dynamic (GAD) Framework, a multi-agent system that leverages collaborative LLMs. In contrast to using a single LLM as the predictor, GAD incorporates global and local summary agents to generate domain-specific knowledge, enhancing its transferability across domains. Additionally, knowledge reflection agents enable adaptive updates to GAD's knowledge, maintaining a unified and self-consistent architecture. In experiments, GAD demonstrates performance comparable to or even exceeds that of full-supervised graph neural networks without dataset-specific training. Finally, to enhance the task-specific performance of LLM-based predictors, we discuss potential improvements, such as dataset-specific fine-tuning to LLMs. By developing tailored strategies for different tasks, we provide new insights for the future design of LLM-based predictors.

动态图大模型多智能体预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。