arXiv:2410.12609cs.LGcs.AI2024-10NeurIPS被引 4

在知识图谱上训练图模型,实现跨任务跨领域的零样本迁移。

Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphs

  • 设计统一拓扑结构与语义感知消息传递机制,融合结构与语义不变性。
  • 在38个不同图数据集上验证,零样本推理性能显著优于现有基线。
  • 适合需要跨领域泛化的图学习任务,如推荐、问答与链接预测。

受大型语言模型成功的启发,构建图基础模型以支持多领域下游任务成为趋势。然而,现有模型通常需额外微调才能将学到的结构与语义表示应用于新图,限制了其通用性。近期知识图谱(KG)上的零样本归纳推理突破,为扩展至通用图应用提供了新思路。本文提出SCR框架,通过在知识图谱上训练,实现对多种图任务与领域的有效泛化。我们首先设计任务特定的KG结构,建立统一拓扑;随后提出语义条件消息传递机制,解决传统KG推理中的语义隔离问题,联合建模图表示中的结构与语义不变性。为验证有效性,我们在覆盖节点级、链接级和图级任务的38个多样化图数据集上评估了SCR的归纳推理能力。结果表明,其性能显著优于现有基础模型与监督基线,充分证明了方法的有效性与适应性。

原文摘要 · Abstract (English)

Inspired by the success of large language models, there is a trend toward developing graph foundation models to conduct diverse downstream tasks in various domains. However, current models often require extra fine-tuning to apply their learned structural and semantic representations to new graphs, which limits their versatility. Recent breakthroughs in zero-shot inductive reasoning on knowledge graphs (KGs), offer us a new perspective on extending KG reasoning to general graph applications. In this paper, we introduce SCR, a unified graph reasoning framework designed to train on knowledge graphs and effectively generalize across a wide range of graph tasks and domains. We begin by designing the task-specific KG structures to establish a unified topology for different task formats. Then we propose semantic-conditioned message passing, a novel mechanism addressing the inherent semantic isolation in traditional KG reasoning, by jointly modeling structural and semantic invariance patterns in graph representations. To demonstrate the effectiveness, we evaluate the inductive reasoning capability of SCR using 38 diverse graph datasets, covering node-level, link-level, and graph-level tasks across multiple domains. Our results show substantial performance gains over existing foundation models and supervised baselines, highlighting the efficacy and adaptability of our approach.

图神经网络知识图谱零样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。