解决知识图谱嵌入中模式过度泛化的难题,提升链接预测性能。
Pattern Over-Generalization of Knowledge Graph Embedding
- 用密集线性变换和复合操作建模关系,避免单一实例泛化到全部
- 在观测到d+1个线性无关实体后,确保模式全局通用性
- 在3个基准数据集上优于当前最优模型,适合高精度链接预测场景
知识图谱嵌入(KGE)通过将实体和关系映射到低维向量空间,在预测知识图谱缺失链接方面表现出色。有效捕捉图中固有的推理模式(如对称性、反对称性、逆关系和复合关系)至关重要。尽管近期的KGE模型在建模多样化模式方面能力强劲,但仍存在模式过度泛化的固有缺陷:仅从单个模式实例学习的嵌入会无差别地推广到所有相关实例。为此,我们提出PogRE(Pattern Over-Generalization Robust Embedding),一种简单而有效的关系表示方法,采用密集线性变换与复合操作。理论分析表明,随着观察到的三元组数量增加,密集线性变换使模式逐渐趋于全局通用;当观测到d+1个线性无关实体(d为实体维度)时,该变换可保证模式在所有相关实例上的普遍适用。在三个标准基准数据集上的实验结果表明,PogRE在链接预测任务中超越现有最先进模型。此外,实证结果验证了PogRE有效缓解了过度泛化的负面影响。
原文摘要 · Abstract (English)
Knowledge graph embedding (KGE) demonstrates its effectiveness for predicting missing links in knowledge graphs (KGs) by projecting entities and relations into a low-dimensional vector space. It is crucial for KGE models to effectively capture inference patterns (patterns) inherent in KGs, such as symmetry/antisymmetry, inversion and composition. Although recent KGE models exhibit strong capabilities in modeling such diverse patterns, they suffer from inherent limitations stemming from pattern over-generalization, where embeddings learned from only a single pattern instance inevitably generalize that pattern to all related instances, i.e., generalize the pattern universally. To address this issue, we propose PogRE (Pattern Over-Generalization Robust Embedding), a simple but effective method that utilizes dense linear transformations and compound operations for relation representation. Our theoretical analysis demonstrates that a dense linear transformation allows a pattern to become progressively universal as more triples are observed in the pattern. Furthermore, after observing d+1 linearly independent entities (d+1 denotes the dimension of entity), the linear transformation guarantees universal generalization of the pattern across all related instances. Experimental results on three standard benchmark datasets show that PogRE outperforms existing state-of-the-art KGE models in link prediction. Moreover, our empirical results indicate that PogRE effectively addresses the negative impact of over-generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。