arXiv:2410.07592cs.AI2024-10

提出一种自适应多样化负采样方法,提升知识图谱嵌入效果

Diversified and Adaptive Negative Sampling on Knowledge Graphs

  • 设计双向生成器与自适应机制,增强负样本多样性与针对性
  • 在三个基准数据集上显著提升模型性能,验证方法有效性
  • 适合关注知识图谱表示学习与负样本优化的研究者

在知识图谱嵌入中,负三元组对模型性能有直接影响。由于知识图谱稀疏且不完整,负三元组通常无明确标签,常通过替换正三元组中的实体等采样策略获得。理想的负三元组应具备足够信息量以促进模型训练。然而,现有方法忽视采样过程中的多样性和自适应性,影响负样本的有用性。为此,本文提出一种生成对抗框架DANS(Diversified and Adaptive Negative Sampling),其包含双向生成器,通过两条路径生成更多样化的负三元组;同时引入自适应机制,针对不同实体和关系局部化全局生成器,实现更细粒度采样。一方面,双向生成器提升整体信息量;另一方面,自适应机制增强个体样本的信息性。我们在三个基准知识图谱上评估DANS,通过定量与定性实验验证其有效性。

原文摘要 · Abstract (English)

In knowledge graph embedding, aside from positive triplets (ie: facts in the knowledge graph), the negative triplets used for training also have a direct influence on the model performance. In reality, since knowledge graphs are sparse and incomplete, negative triplets often lack explicit labels, and thus they are often obtained from various sampling strategies (eg: randomly replacing an entity in a positive triplet). An ideal sampled negative triplet should be informative enough to help the model train better. However, existing methods often ignore diversity and adaptiveness in their sampling process, which harms the informativeness of negative triplets. As such, we propose a generative adversarial approach called Diversified and Adaptive Negative Sampling DANS on knowledge graphs. DANS is equipped with a two-way generator that generates more diverse negative triplets through two pathways, and an adaptive mechanism that produces more fine-grained examples by localizing the global generator for different entities and relations. On the one hand, the two-way generator increase the overall informativeness with more diverse negative examples; on the other hand, the adaptive mechanism increases the individual sample-wise informativeness with more fine-grained sampling. Finally, we evaluate the performance of DANS on three benchmark knowledge graphs to demonstrate its effectiveness through quantitative and qualitative experiments.

知识图谱负采样生成对抗嵌入学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。