arXiv:2409.20053cs.AIcs.CL2024-09被引 6

让大模型学会理解图结构,提升复杂推理能力。

GUNDAM: Aligning Large Language Models with Graph Understanding

  • 设计新模型GUNDAM,使大模型能直接利用图结构进行推理。
  • 在多个基准测试中超越现有最优方法,显著提升图推理性能。
  • 揭示了推理路径对模型能力的关键作用,适合图神经网络与LLM交叉研究者。

大型语言模型(LLMs)在文本处理上取得了显著成果,激发了将其应用于非文本数据(如图结构数据)的兴趣。当前研究多集中于富含文本特征的图,如知识图谱或带文本属性的图,依赖模型处理文本的能力,却忽视了图结构本身的价值。本文旨在评估并增强LLMs对图结构知识的理解与利用能力,提出新型模型GUNDAM(Graph Understanding for Natural Language Driven Analytical Model),通过适配使大模型能够基于图结构执行复杂推理任务。实验在多个图推理基准上验证了该模型优于现有最先进方法,并揭示了影响模型推理能力的关键因素。此外,我们提供了理论分析,说明推理路径如何增强大模型的推理能力。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have achieved impressive results in processing text data, which has sparked interest in applying these models beyond textual data, such as graphs. In the field of graph learning, there is a growing interest in harnessing LLMs to comprehend and manipulate graph-structured data. Existing research predominantly focuses on graphs with rich textual features, such as knowledge graphs or text attribute graphs, leveraging LLMs' ability to process text but inadequately addressing graph structure. This work specifically aims to assess and enhance LLMs' abilities to comprehend and utilize the structural knowledge inherent in graph data itself, rather than focusing solely on graphs rich in textual content. To achieve this, we introduce the \textbf{G}raph \textbf{U}nderstanding for \textbf{N}atural Language \textbf{D}riven \textbf{A}nalytical \textbf{M}odel (\model). This model adapts LLMs to better understand and engage with the structure of graph data, enabling them to perform complex reasoning tasks by leveraging the graph's structure itself. Our experimental evaluations on graph reasoning benchmarks not only substantiate that \model~ outperforms the SOTA baselines for comparisons. But also reveals key factors affecting the graph reasoning capabilities of LLMs. Moreover, we provide a theoretical analysis illustrating how reasoning paths can enhance LLMs' reasoning capabilities.

图神经网络大模型推理能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。