arXiv:2409.19977cs.LGcs.AI2024-09AAAI被引 11

用群论统一知识图谱嵌入,引入不确定性提升表达能力。

Knowledge Graph Embedding by Normalizing Flows

论文配图:Knowledge Graph Embedding by Normalizing Flows
图 1 · 摘自论文原文
  • 将实体/关系建模为对称群中的置换,统一现有模型
  • 通过变换随机变量生成复杂分布,增强表示能力
  • 支持逻辑规则学习,适合需要不确定性的推理任务

知识图谱嵌入(KGE)的关键在于选择合适的表示空间,如点式欧氏空间或复向量空间。本文提出一种统一的嵌入视角,从群论角度引入不确定性。模型可融合现有方法(通用性)、保证计算可处理(高效性),并具备复随机变量的表达能力(表现力)。核心思想是将实体/关系嵌入为对称群元素,即集合的置换。不同集合的置换可反映嵌入的不同属性,且对称群的运算易于计算。我们证明,许多现有模型中的点向量可视为对称群元素。为引入不确定性,将实体/关系嵌入为随机变量集合的置换,置换可将简单随机变量转化为复杂随机变量,称为归一化流(NFE)。通过测量两个归一化流的相似性定义打分函数。构建多个实例化模型,并证明其可学习逻辑规则。实验验证了引入不确定性的有效性。代码已公开于 https://github.com/changyi7231/NFE。

原文摘要 · Abstract (English)

A key to knowledge graph embedding (KGE) is to choose a proper representation space, e.g., point-wise Euclidean space and complex vector space. In this paper, we propose a unified perspective of embedding and introduce uncertainty into KGE from the view of group theory. Our model can incorporate existing models (i.e., generality), ensure the computation is tractable (i.e., efficiency) and enjoy the expressive power of complex random variables (i.e., expressiveness). The core idea is that we embed entities/relations as elements of a symmetric group, i.e., permutations of a set. Permutations of different sets can reflect different properties of embedding. And the group operation of symmetric groups is easy to compute. In specific, we show that the embedding of many existing models, point vectors, can be seen as elements of a symmetric group. To reflect uncertainty, we first embed entities/relations as permutations of a set of random variables. A permutation can transform a simple random variable into a complex random variable for greater expressiveness, called a normalizing flow. We then define scoring functions by measuring the similarity of two normalizing flows, namely NFE. We construct several instantiating models and prove that they are able to learn logical rules. Experimental results demonstrate the effectiveness of introducing uncertainty and our model. The code is available at https://github.com/changyi7231/NFE.

知识图谱嵌入不确定性群论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。