统一图语言模型实现跨领域多任务图表示对齐,提升通用性。
A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning

- 采用多领域多任务GNN编码器学习通用图表示
- 通过自适应对齐策略实现图与文本语义的统一嵌入
- 适合需要跨域图数据理解的AI研究者使用
将图神经网络(GNN)作为图编码器,并通过对齐指令微调将生成的表示与大型语言模型(LLM)对齐,已成为构建图语言模型(GLM)的主流范式,融合了LLM的泛化能力与GNN的结构建模能力。然而,现有采用GNN作为图编码器的GLM大多忽略了在不同领域和任务间对齐GNN编码表示与LLM词元空间以获得统一图标记的问题,限制了其在多样化图数据上的泛化能力。为弥合这一差距,本文旨在将多领域、多任务的GNN编码器引入GLM,并通过多领域、多任务图对齐指令微调实现表征对齐。该对齐问题尚未被充分探索,面临两大挑战:1)学习同时具备跨领域、跨任务泛化性且与文本语义对齐的GNN表示困难,因图结构、特征分布和监督信号差异大,且任务特定的GNN训练缺乏文本语义对齐引导;2)多样化的图数据与任务特定指令在指令微调过程中与LLM词元空间的兼容性不一,导致对齐难度各异,固定对齐策略效果不佳。为此,我们提出UniGraphLM,一种集成多领域、多任务GNN编码器的统一图语言模型,能够学习与文本语义对齐的通用图表示,并自适应地将其与LLM对齐。
原文摘要 · Abstract (English)
Leveraging Graph Neural Networks (GNNs) as graph encoders and aligning the resulting representations with Large Language Models (LLMs) through alignment instruction tuning has become a mainstream paradigm for constructing Graph Language Models (GLMs), combining the generalization ability of LLMs with the structural modeling capacity of GNNs. However, existing GLMs that adopt GNNs as graph encoders largely overlook the problem of aligning GNN-encoded representations across domains and tasks with the LLM token space to obtain unified graph tokens, thereby limiting their ability to generalize across diverse graph data. To bridge this gap, we aim to incorporate a multi-domain, multi-task GNN encoder into GLMs and align its representations with LLMs to enable multi-domain, multi-task graph alignment instruction tuning. This alignment problem remains underexplored and poses two key challenges: 1) learning GNN-encoded representations that are simultaneously generalizable across domains and tasks and well aligned with textual semantics is difficult, due to substantial variations in graph structures, feature distributions, and supervision signals, together with the lack of textual-semantic alignment guidance in task-specific GNN training; 2) diverse graph data and task-specific instructions can exhibit different degrees of compatibility with the LLM token space during instruction tuning, leading to varying alignment difficulty and rendering a fixed alignment strategy suboptimal. To tackle these challenges, we propose UniGraphLM, a Unified Graph Language Model that incorporates a multi-domain, multi-task GNN encoder to learn generalizable graph representations aligned with textual semantics, and then adaptively aligns these representations with the LLM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。