arXiv:2606.11898cs.CLcs.LG2026-06

用大模型理解图结构,实现跨数据集零样本泛化

GraspLLM: Towards Zero-Shot Generalization on Text-Attributed Graphs with LLMs

论文配图:GraspLLM: Towards Zero-Shot Generalization on Text-Attributed Graphs with LLMs
图 1 · 摘自论文原文
  • 将节点文本统一嵌入语义空间,通过图案对比学习提取通用结构信息
  • 在多个基准数据集上零样本场景下性能超越现有方法
  • 适合需要跨领域图数据推理的研究者和工业应用

文本属性图(TAGs)在引文网络、电商、社交媒体和网页等实际场景中广泛应用。尽管大型语言模型(LLMs)具备强大的语义理解能力,但现有方法在不同图和任务间的泛化能力仍不足,难以捕捉可迁移的图结构模式。为此,我们提出GraspLLM框架,融合图结构理解与LLM的语义能力,提升跨数据集和跨任务的泛化性。具体地,使用冻结的通用嵌入模型将不同图中的节点文本映射到统一语义空间,并基于多图案诱导的邻接矩阵进行图案感知的对比学习,以提取与数据集无关的结构信息。随后,利用提出的最优上下文子图,为每个目标节点提取最相关的上下文子图,并通过对齐投影器将其映射到LLM的标记空间。在涵盖多个领域的TAG基准数据集上的大量实验表明,GraspLLM在零样本场景下持续优于以往基于LLM的方法,展现出强大的跨数据集和跨任务泛化能力。代码已公开于https://github.com/Heinz217/GraspLLM。

原文摘要 · Abstract (English)

Research on Text-Attributed Graphs (TAGs) has gained significant attention recently due to its broad applications across various real-world data scenarios, such as citation networks, e-commerce platforms, social media, and web pages. Inspired by the remarkable semantic understanding ability of Large Language Models (LLMs), there have been numerous attempts to integrate LLMs into TAGs. However, existing methods still struggle to generalize across diverse graphs and tasks, and their ability to capture transferable graph structural patterns remains limited. To address this, we introduce the GraspLLM, a framework that combines Graph structural comprehension with semantic understanding prowess of LLMs to enhance the cross-dataset and cross-task generalizability. Specifically, we represent node texts from different graphs in a unified semantic space with a frozen general embedding model, on top of which we perform motif-aware contrastive learning across multiple motif-induced adjacency matrices to extract dataset-agnostic structural information. Then, with our proposed optimal contextual subgraph, we extract the most contextually relevant subgraph for each target node and align these subgraphs to the token space of LLM via an alignment projector. Extensive experiments on TAG benchmark datasets spanning diverse domains reveal that GraspLLM consistently outperforms previous LLM-based methods for TAGs, especially in zero-shot scenarios, highlighting its strong generalizability across different datasets and tasks. Our code is available at https://github.com/Heinz217/GraspLLM.

图神经网络大模型零样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。