通过负例语句增强知识图谱嵌入,提升链接预测效果
Improving Knowledge Graph Embeddings through Contrastive Learning with Negative Statements
- 双模型并行学习正负例,互相生成难样本进行对比训练
- 在多个知识图谱上显著优于当前最佳模型,尤其在负例识别任务中
- 适合需要区分真假关系的推荐与问答系统应用
知识图谱以结构化三元组形式表示信息,是问答、链接预测和推荐系统的核心。现有嵌入方法多基于封闭世界假设,将缺失三元组视为假,但真实知识图谱遵循开放世界假设。显式负例能有效区分虚假与未知三元组,却极少被纳入图谱且常被忽略。本文提出一种新方法,将显式负例融入嵌入学习过程。采用双模型架构,分别对正负例训练,每轮训练中,各模型通过扰动正例并利用另一模型评分,筛选最可能的负样本。在通用及领域特定知识图谱上评估,聚焦链接预测与三元组分类任务。实验表明,该方法显著优于现有先进模型,验证了融入有意义负知识的价值。
原文摘要 · Abstract (English)
Knowledge graphs represent information as structured triples and serve as the backbone for a wide range of applications, including question answering, link prediction, and recommendation systems. A prominent line of research for exploring knowledge graphs involves graph embedding methods, where entities and relations are represented in low-dimensional vector spaces that capture underlying semantics and structure. However, most existing methods rely on assumptions such as the Closed World Assumption or Local Closed World Assumption, treating missing triples as false. This contrasts with the Open World Assumption underlying many real-world knowledge graphs. Furthermore, while explicitly stated negative statements can help distinguish between false and unknown triples, they are rarely included in knowledge graphs and are often overlooked during embedding training. In this work, we introduce a novel approach that integrates explicitly declared negative statements into the knowledge embedding learning process. Our approach employs a dual-model architecture, where two embedding models are trained in parallel, one on positive statements and the other on negative statements. During training, each model generates negative samples by corrupting positive samples and selecting the most likely candidates as scored by the other model. The proposed approach is evaluated on both general-purpose and domain-specific knowledge graphs, with a focus on link prediction and triple classification tasks. The extensive experiments demonstrate that our approach improves predictive performance over state-of-the-art embedding models, demonstrating the value of integrating meaningful negative knowledge into embedding learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。