用大模型分析动态图,能预测链接还能生成解释。
Are Large Language Models Good Temporal Graph Learners?
- 利用时间邻域和近期性提取结构信息转为自然语言输入大模型
- 在5个真实动态图上性能媲美顶尖TGNN模型,优于TGN/HTGN
- 输出可解释的文本预测理由,适合需要透明性的场景
大型语言模型(LLMs)在自然语言处理及其他领域取得显著进展。尽管已有研究探讨了LLMs在静态图上的推理能力,但其在动态图——即现实世界中演化的网络——中的应用仍相对较少。现有工作多基于随机图模型生成的合成时间图,而将LLMs应用于真实时间图仍是开放问题。为此,我们提出时间图对话者(Temporal Graph Talker, TGTalker),一种专为LLMs设计的时间图学习框架。TGTalker利用时间图中的近期性偏差提取相关结构信息,并将其转化为自然语言供LLMs处理,同时引入时间邻域作为额外预测依据。实验表明,TGTalker在链接预测任务上表现优异,在五个真实世界网络上与最先进的时序图神经网络(TGNN)方法相当,且持续优于TGN和HTGN等主流模型。此外,TGTalker能为每次预测生成文本解释,推动了时序链接预测在可解释性方面的创新。代码已公开于https://github.com/shenyangHuang/TGTalker。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have recently driven significant advancements in Natural Language Processing and various other applications. While a broad range of literature has explored the graph-reasoning capabilities of LLMs, including their use of predictors on graphs, the application of LLMs to dynamic graphs -- real world evolving networks -- remains relatively unexplored. Recent work studies synthetic temporal graphs generated by random graph models, but applying LLMs to real-world temporal graphs remains an open question. To address this gap, we introduce Temporal Graph Talker (TGTalker), a novel temporal graph learning framework designed for LLMs. TGTalker utilizes the recency bias in temporal graphs to extract relevant structural information, converted to natural language for LLMs, while leveraging temporal neighbors as additional information for prediction. TGTalker demonstrates competitive link prediction capabilities compared to existing Temporal Graph Neural Network (TGNN) models. Across five real-world networks, TGTalker performs competitively with state-of-the-art temporal graph methods while consistently outperforming popular models such as TGN and HTGN. Furthermore, TGTalker generates textual explanations for each prediction, thus opening up exciting new directions in explainability and interpretability for temporal link prediction. The code is publicly available at https://github.com/shenyangHuang/TGTalker.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。