arXiv:2412.12456cs.LGcs.AI2024-12综述被引 15

将LLM与GNN结合,用文本提升图学习效果。

Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks

  • 用LLM理解图文本描述,增强图结构表征
  • 实现跨领域图任务的少样本与零样本泛化
  • 适合研究图神经网络与大模型融合的学者

随着跨领域文本属性图(TAG)数据(如引用网络、推荐系统、社交网络和ai4science)的广泛应用,将图神经网络(GNN)与大型语言模型(LLM)整合为统一架构(如LLM作为增强器、合作者或预测器)已成为一种有前景的技术范式。该新范式的核心在于协同利用GNN捕捉复杂结构关系的能力和LLM理解图文本丰富语义上下文的优势。通过利用具有丰富语义信息的图描述文本,可从根本上提升数据质量,从而增强以模型为中心的方法在数据驱动机器学习原则下的表示能力。借助两种神经网络架构的优势,该集成方法能有效应对多种基于TAG的任务(如图学习、图推理和图问答),尤其适用于监督、少样本及零样本等复杂工业场景。换言之,可将文本视为媒介,实现图学习模型在不同数据域间的跨领域泛化,使单一图模型有效处理多样化下游任务。本文为研究者和实践者在快速演进的LLM背景下推进图学习方法提供基础参考。相关开源资源持续维护于: https://github.com/xkLi-Allen/Awesome-GNN-in-LLMs-Papers

原文摘要 · Abstract (English)

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models (LLMs) into a unified Model architecture (e.g., LLM as enhancer, LLM as collaborators, LLM as predictor) has emerged as a promising technological paradigm. The core of this new graph learning paradigm lies in the synergistic combination of GNNs' ability to capture complex structural relationships and LLMs' proficiency in understanding informative contexts from the rich textual descriptions of graphs. Therefore, we can leverage graph description texts with rich semantic context to fundamentally enhance Data quality, thereby improving the representational capacity of model-centric approaches in line with data-centric machine learning principles. By leveraging the strengths of these distinct neural network architectures, this integrated approach addresses a wide range of TAG-based Task (e.g., graph learning, graph reasoning, and graph question answering), particularly in complex industrial scenarios (e.g., supervised, few-shot, and zero-shot settings). In other words, we can treat text as a medium to enable cross-domain generalization of graph learning Model, allowing a single graph model to effectively handle the diversity of downstream graph-based Task across different data domains. This work serves as a foundational reference for researchers and practitioners looking to advance graph learning methodologies in the rapidly evolving landscape of LLM. We consistently maintain the related open-source materials at \url{https://github.com/xkLi-Allen/Awesome-GNN-in-LLMs-Papers}.

图学习大模型文本增强跨域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。