arXiv:2605.06154cs.AIcs.LG2026-05

用小图结构作为知识图谱的通用词汇,提升模型跨图泛化能力。

Graphlets as Building Blocks for Structural Vocabulary in Knowledge Graph Foundation Models

论文配图:Graphlets as Building Blocks for Structural Vocabulary in Knowledge Graph Foundation Models
图 1 · 摘自论文原文
  • 将小图模式(图元)当作结构化符号,构建通用词汇表。
  • 在51个不同领域知识图谱上实现零样本链接预测,性能超越已有模型。
  • 方法不依赖特定模型,适合需要跨图迁移的场景。

基础模型在语言和视觉任务中表现优异,因其将句子和图像转化为离散符号并基于固定网格处理。知识图谱虽具离散性,但缺乏统一几何结构,其实体与关系构成非欧几里得、不规则的拓扑,局部结构因图而异。因此,知识图谱基础模型(KGFMs)需依赖结构不变性以生成可迁移表示。然而,缺乏通用符号集限制了其在未见图上的迁移能力。本文提出以图元——即小型连通子图——作为重复出现于异构知识图谱中的结构符号,构建模型无关的框架。通过模式匹配挖掘知识图谱间的关联,重点考虑闭合与开放的2-路径、3-路径及星型图元,以获得稳健的结构不变性。该框架在51个来自多领域知识图谱上评估,涵盖零样本归纳与直推式链接预测。实验表明,引入简单图元即可显著提升模型性能,优于现有KGFMs。

原文摘要 · Abstract (English)

Foundation models excel at language, where sentences become tokens, and vision, where images become pixels, because both reduce to discrete symbols on a shared, fixed grid. Knowledge Graphs share the discreteness, but not the geometry. Their entities and relations are discrete symbols, yet their arrangement is relational and lacks a common, fixed grid. Knowledge Graphs (KGs) share the discreteness, but not the geometry. They form irregular, non-Euclidean topologies whose local neighborhoods differ from graph to graph. Therefore, Knowledge Graph Foundation Models (KGFMs) rely on identifying structural invariances to produce transferable representations. Without a universal token set, KGFMs are limited in their ability to transfer representations across unseen KGs. We close this gap by treating graphlets, small connected graphs, as structural tokens that recur in heterogeneous KGs. In this paper, We introduce a model-agnostic framework based on a vocabulary of graphlets that mines a KG between relations via pattern matching. In particular, we considered closed and open 2- and 3-path, and star graphlets, to obtain robust invariances. The framework is evaluated on 51 KGs from a wide range of domains, for zero-shot inductive and transductive link prediction. Experiments show that adding simple graphlets to the vocabulary yields models that outperform prior KGFMs.

知识图谱图神经网络结构建模零样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。