arXiv:2501.19095cs.AIcs.LG2025-01

用关系路径生成实体嵌入,大幅减少参数量

PathE: Leveraging Entity-Agnostic Paths for Parameter-Efficient Knowledge Graph Embeddings

  • 仅给关系分配嵌入表,通过路径动态计算实体嵌入
  • 参数量低于同类方法25%,在4个基准上达最佳关系预测性能
  • 适合关系多样且连接紧密的真实知识图谱,可跑在普通硬件上

知识图谱(KG)以实体和关系的形式存储人类知识,广泛应用于知识发现、链接预测和推理等任务。传统方法为所有或部分实体分配嵌入表,导致参数量随实体数量线性增长,难以在百万级节点的现实场景中训练。为此,我们提出PathE模型,仅对关系(通常远少于实体)分配嵌入表,参数量不足现有高效方法的25%。不存储实体嵌入,而是通过多条实体-关系路径,将每个实体在三元组中上下文化地动态生成其嵌入。在四个基准上评估,PathE在关系预测任务上达到当前最优表现,且在路径丰富的知识图谱上保持链接预测竞争力,训练可在消费级硬件完成。消融实验验证设计合理性,分析关键超参数敏感性。PathE适用于关系多样且连通性强的现实知识图谱。

原文摘要 · Abstract (English)

Knowledge Graphs (KGs) store human knowledge in the form of entities (nodes) and relations, and are used extensively in various applications. KG embeddings are an effective approach to addressing tasks like knowledge discovery, link prediction, and reasoning. This is often done by allocating and learning embedding tables for all or a subset of the entities. As this scales linearly with the number of entities, learning embedding models in real-world KGs with millions of nodes can be computationally intractable. To address this scalability problem, our model, PathE, only allocates embedding tables for relations (which are typically orders of magnitude fewer than the entities) and requires less than 25% of the parameters of previous parameter efficient methods. Rather than storing entity embeddings, we learn to compute them by leveraging multiple entity-relation paths to contextualise individual entities within triples. Evaluated on four benchmarks, PathE achieves state-of-the-art performance in relation prediction, and remains competitive in link prediction on path-rich KGs while training on consumer-grade hardware. We perform ablation experiments to test our design choices and analyse the sensitivity of the model to key hyper-parameters. PathE is efficient and cost-effective for relationally diverse and well-connected KGs commonly found in real-world applications.

知识图谱嵌入模型参数效率路径学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。