arXiv:2504.03327cs.LGcs.CL2025-04中稿 · and to be publishe…被引 2

提出新方法生成高质量负样本,显著提升知识图谱链接预测效果。

Optimal Embedding Guided Negative Sample Generation for Knowledge Graph Link Prediction

  • 基于嵌入优化理论,主动生成满足条件的负样本
  • 在多个数据集上提升链接预测性能,等效于五倍维度模型
  • 可无缝集成现有模型,适合追求精度的图学习研究者

知识图谱嵌入(KGE)模型通过编码图结构信息来预测新链接。有效训练依赖于正负样本的精确区分。尽管提升负样本质量能显著提高模型准确率,但如何识别高质量负样本仍是难题。本文从理论上分析了使嵌入达到最优时负样本应满足的条件,并提出一种新的负样本生成框架 extsc{EMU},其核心是生成满足该条件的负样本,而非仅筛选训练数据中的难例。 extsc{EMU} 结构简单,可与现有 KGE 模型和负采样方法无缝集成。在多个数据集上的实验表明,其在不同模型和采样策略下均实现显著性能提升,尤其在某些场景下表现相当于嵌入维度扩大五倍的模型。代码与实验已公开于 https://github.com/nec-research/EMU-KG。

原文摘要 · Abstract (English)

Knowledge graph embedding (KGE) models encode the structural information of knowledge graphs to predicting new links. Effective training of these models requires distinguishing between positive and negative samples with high precision. Although prior research has shown that improving the quality of negative samples can significantly enhance model accuracy, identifying high-quality negative samples remains a challenging problem. This paper theoretically investigates the condition under which negative samples lead to optimal KG embedding and identifies a sufficient condition for an effective negative sample distribution. Based on this theoretical foundation, we propose \textbf{E}mbedding \textbf{MU}tation (\textsc{EMU}), a novel framework that \emph{generates} negative samples satisfying this condition, in contrast to conventional methods that focus on \emph{identifying} challenging negative samples within the training data. Importantly, the simplicity of \textsc{EMU} ensures seamless integration with existing KGE models and negative sampling methods. To evaluate its efficacy, we conducted comprehensive experiments across multiple datasets. The results consistently demonstrate significant improvements in link prediction performance across various KGE models and negative sampling methods. Notably, \textsc{EMU} enables performance improvements comparable to those achieved by models with embedding dimension five times larger. An implementation of the method and experiments are available at https://github.com/nec-research/EMU-KG.

知识图谱负样本生成嵌入优化链接预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。