arXiv:2510.16885cs.LG2025-10NeurIPS被引 8

让大模型同时理解图结构和自然语言,实现跨任务零样本推理

UniGTE: Unified Graph-Text Encoding for Zero-Shot Generalization across Graph Tasks and Domains

  • 用可学习的对齐标记和结构感知注意力,统一编码图与文本
  • 在5个数据集上零样本表现超越现有方法,跨任务/域准确率提升
  • 适合需要通用图推理能力的研究者和工业应用

将未见过的图任务进行零样本泛化极具挑战:传统图神经网络通常绑定固定标签空间,而大语言模型(LLM)难以捕捉图结构。我们提出UniGTE,一个指令微调的编码器-解码器框架,统一结构与语义推理。编码器通过可学习对齐标记和结构感知图-文本注意力机制,增强预训练自回归大模型,使其能联合关注分词后的图和自然语言任务提示,且保持节点顺序无关性。该设计生成紧凑、任务感知的图表示。仅基于这些表示,冻结的LLM解码器输出任务答案并同时以自然语言重述输入图。重建目标正则化编码器以保留结构信息。UniGTE在涵盖节点级、边级、图级任务的五个跨领域数据集上进行指令微调,推理时无需微调。在跨任务和跨域设置下,其节点分类、链接预测、图分类与图回归任务均达到新最优零样本性能,表明图结构与大模型语义的紧密融合可实现稳健、可迁移的图推理。

原文摘要 · Abstract (English)

Generalizing to unseen graph tasks without task-specific supervision is challenging: conventional graph neural networks are typically tied to a fixed label space, while large language models (LLMs) struggle to capture graph structure. We introduce UniGTE, an instruction-tuned encoder-decoder framework that unifies structural and semantic reasoning. The encoder augments a pretrained autoregressive LLM with learnable alignment tokens and a structure-aware graph-text attention mechanism, enabling it to attend jointly to a tokenized graph and a natural-language task prompt while remaining permutation-invariant to node order. This yields compact, task-aware graph representations. Conditioned solely on these representations, a frozen LLM decoder predicts and reconstructs: it outputs the task answer and simultaneously paraphrases the input graph in natural language. The reconstruction objective regularizes the encoder to preserve structural cues. UniGTE is instruction-tuned on five datasets spanning node-level, edge-level, and graph-level tasks across diverse domains, yet requires no fine-tuning at inference. It achieves new state-of-the-art zero-shot results on node classification, link prediction, graph classification, and graph regression under cross-task and cross-domain settings, demonstrating that tight integration of graph structure with LLM semantics enables robust, transferable graph reasoning.

图神经网络大模型零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。