arXiv:2510.01510cs.LG2025-10被引 5

用随机游走学习知识图谱,让模型能预测新实体和新关系。

Flock: A Knowledge Graph Foundation Model via Learning on Random Walks

  • 通过随机游走生成序列,用模型编码并聚合表示
  • 在54个不同领域图谱上达到顶尖性能,诊断数据集上表现完美
  • 适合研究知识图谱泛化与结构学习的学者

我们研究知识图谱上的零样本链接预测问题,要求模型能推广到未见的实体和关系。现有知识图谱基础模型通过节点与关系的确定性等变性来学习结构特征,但这种设计限制了表达能力,无法区分结构相似但语义不同的关系。为此,我们提出概率性节点-关系等变性,在保持分布等变的同时引入结构化随机性以打破推理时的对称性。基于此,我们提出Flock:通过迭代采样随机游走,将路径编码为序列,使用序列模型嵌入,并通过可学习池化聚合节点与关系表示。Flock满足概率等变性,且是同构不变链接级函数的通用近似器。实验表明,Flock在新提出的诊断数据集Petals上完全解决现有模型失败的问题,并在54个跨领域知识图谱的实体与关系预测任务中取得最佳表现。代码已开源。

原文摘要 · Abstract (English)

We study the problem of zero-shot link prediction on knowledge graphs (KGs), which requires models to generalize to novel entities and novel relations. Knowledge graph foundation models (KGFMs) address this task by enforcing equivariance over both nodes and relations, which enables them to learn structural properties of nodes and relations that transfer to novel KGs with similar structure. However, the conventional notion of deterministic equivariance inherently limits the expressive power of KGFMs, as it prevents them from distinguishing relations that are structurally similar but semantically distinct. To overcome this limitation, we propose to leverage probabilistic node-relation equivariance, which preserves equivariance in distribution while using structured randomness to break symmetries at inference time. Building on this principle, we present Flock, a KGFM that iteratively samples random walks, encodes them into sequences, embeds them with a sequence model, and aggregates node and relation representations through learned pooling. Flock respects probabilistic node-relation equivariance and, crucially, is a universal approximator for isomorphism-invariant link-level functions over KGs. Empirically, Flock perfectly solves our new diagnostic dataset Petals on which current KGFMs fail, and achieves state-of-the-art performance on entity and relation prediction tasks across 54 KGs from diverse domains. Code is available at https://github.com/jw9730/flock.

知识图谱随机游走基础模型零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。