arXiv:2605.27023cs.AI2026-05

通过动态生成难负例,提升知识图谱基础模型的零样本补全能力。

Boosting Knowledge Graph Foundation Models via Enhanced Negative Sampling

  • 基于关系嵌入动态构建难负例,替代随机采样。
  • 在44个数据集上显著提升多个SOTA模型性能。
  • 自适应调整负例比例,训练高效且不增加资源开销。

知识图谱(KGs)是问答和推荐系统等下游任务的核心。然而,知识图谱常存在严重缺失。为在未见知识图谱上实现零样本知识图谱补全(关系词汇与预训练不同),知识图谱基础模型(KGFMs)受到广泛关注。现有KGFMs多采用随机负三元组进行训练,即用随机实体替换正三元组的头或尾实体,但此类负例质量有限,难以提供有效监督。本文提出一种简单而有效的自适应负采样方法KMAS,通过现有KGFM的关系编码器生成的更新关系嵌入构造难负三元组。为动态适配训练过程中KGFM能力的演化,KMAS在预热阶段后线性增加负例比例,随后线性降低。在44个数据集上进行了广泛实验,结果表明,该方法可有效增强多种SOTA KGFMs,且无需额外大量时间和内存消耗。

原文摘要 · Abstract (English)

Knowledge graphs (KGs) have become the core backbone of numerous downstream tasks such as question answering and recommender systems. However, despite all this, KGs are often very incomplete. To perform zero-shot knowledge graph completion in unseen KGs, which have different relational vocabularies from those used for pre-training, KG foundation models (KGFMs) receive a wide range of attention. Existing KGFMs often perform training using random negative triples, which are constructed by replacing the head or tail entity of a positive triple with a random entity. However, these negative triples are often constructed with limited quality, providing weak supervision for KGFM training. In this paper, we propose a simple yet effective adaptive negative sampling approach, KMAS, to enhance existing KGFMs. KMAS constructs hard negative triples through the updated relation embeddings generated from the existing KGFM's relation encoder. To further adaptively align with the evolving capability of the KGFM during the training process, KMAS adjusts the ratio of hard negative triples dynamically throughout the whole training process: after a warmup phrase, it increases the ratio linearly and then decreases linearly. Extensive experiments are conducted over 44 data sets. Experimental results demonstrate that our proposed negative sampling method can enhance many SOTA KGFMs without requiring excessive additional time or memory consumption.

知识图谱负采样模型优化零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。