arXiv:2512.22931cs.AIcs.LG2025-12

用多重几何注意力提升知识图谱推理能力,适应新图中新实体关系。

Geometric Structural Knowledge Graph Foundation Model

  • 引入多头几何注意力,用多种数系变换并行建模关系结构。
  • 零样本归纳链接预测中,平均倒数排名提升5.5%,全基准提升4.4%。
  • 适合需要跨图泛化、处理复杂关系模式的研究者使用。

结构化知识图谱基础模型旨在将推理能力泛化到包含未见过实体与关系的新图。现有方法如Ultra依赖单一关系变换(如逐元素乘法)进行消息传递,限制了表达能力,难以捕捉多样图谱中的复杂关系与结构模式。本文提出Gamma,一种新型基础模型,引入多头几何注意力机制。Gamma以多个并行的变换取代单一关系变换,包括实数、复数、分裂复数和双数基变换,分别建模不同关系结构。通过轻量级门控与熵正则化的关系条件注意力融合机制,在链接层面自适应融合这些变换,使模型能稳健突出最适配的每种三元组模式的关系偏置。我们对这些代数消息函数进行了完整形式化,并讨论其组合如何超越单一空间的表达能力。在56个多样化知识图谱上的全面实验表明,Gamma在零样本归纳链接预测上持续优于Ultra,归纳基准下平均倒数排名提升5.5%,所有基准平均提升4.4%,验证了互补几何表示的优势。

原文摘要 · Abstract (English)

Structural knowledge graph foundation models aim to generalize reasoning to completely new graphs with unseen entities and relations. A key limitation of existing approaches like Ultra is their reliance on a single relational transformation (e.g., element-wise multiplication) in message passing, which can constrain expressiveness and fail to capture diverse relational and structural patterns exhibited on diverse graphs. In this paper, we propose Gamma, a novel foundation model that introduces multi-head geometric attention to knowledge graph reasoning. Gamma replaces the single relational transformation with multiple parallel ones, including real, complex, split-complex, and dual number based transformations, each designed to model different relational structures. A relational conditioned attention fusion mechanism then adaptively fuses them at link level via a lightweight gating with entropy regularization, allowing the model to robustly emphasize the most appropriate relational bias for each triple pattern. We present a full formalization of these algebraic message functions and discuss how their combination increases expressiveness beyond any single space. Comprehensive experiments on 56 diverse knowledge graphs demonstrate that Gamma consistently outperforms Ultra in zero-shot inductive link prediction, with a 5.5% improvement in mean reciprocal rank on the inductive benchmarks and a 4.4% improvement across all benchmarks, highlighting benefits from complementary geometric representations.

知识图谱几何注意力零样本推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。