arXiv:2608.23849cs.LG2026-08

用生成模型动态选难负例,提升知识图谱嵌入效果

FlowNeg: GFlowNet-Guided Diverse Hard Negative Sampling for Knowledge Graph Embedding

  • 基于流网络生成分层负例,按关系类型和实体类别逐步采样
  • 在5个基准上平均MRR提升0.0172,比现有方法更少碰撞、更多样
  • 适合追求高精度与负例多样性的知识图谱研究者

负采样决定了知识图谱嵌入(KGE)模型是学习有信息量的反例,还是浪费更新在不合理伪造数据上。均匀负例虽多样但太简单,而硬负例挖掘集中于少数实体且易与保留正例冲突。本文提出FlowNeg,一种上下文感知的分层生成流网络,无需对全实体集归一化复合奖励:给定正三元组和扰动方式,它先选类型再选实体。终端奖励结合有界模型硬度与仅训练时使用的结构得分以避免保留正例冲突,支持关系特定的类型相容集合。推导奖励函数,优化标准轨迹平衡,并定量分析残差不平衡对终端概率与模式概率的乘法影响。在五种架构与五种基准的五种子网格实验中,FlowNeg的平均MRR高于EMU和IF-NS,在24/25个组合中表现更优(平均+0.0172与+0.0160)。独立控制实验(FB15k-237/RotatE,15种子)显示,FlowNeg得0.359±0.001 MRR,优于EMU的0.346±0.002,兼具近似均匀的分区多样性、高梯度信息量与低冲突。结果表明,无需将结构相似性视为开放世界真值,即可实现模式覆盖的负例生成。

原文摘要 · Abstract (English)

Negative sampling determines whether a knowledge graph embedding (KGE) model learns from informative counterexamples or wastes updates on implausible corruptions. Uniform negatives are diverse but easy, whereas hard-negative miners concentrate on few entities and collide more with held-out positives. We introduce FlowNeg, a context-conditioned hierarchical generative flow network that amortizes reward-proportional sampling without normalizing a composite reward over the entity set: given a positive triple and corruption side, it selects a type, then an entity. Its terminal reward combines bounded model-based hardness with a training-only structural score for held-out-positive collision, over a relation-specific type-compatible support. We derive the reward, specialize standard trajectory balance, and bound multiplicatively how residual imbalance perturbs terminal and mode probability. Across a descriptive five-seed grid of five architectures and five benchmarks, FlowNeg has higher mean MRR than EMU and than IF-NS in 24 of 25 cells ($+0.0172$ and $+0.0160$ on average). A separate 15-seed FB15k-237/RotatE control fixing negative count, diagnostic budget, and compute gives FlowNeg $0.359\pm0.001$ MRR against $0.346\pm0.002$ for EMU, with near-uniform fixed-partition diversity, high gradient informativeness, and low collision. The evidence supports mode-covering negative generation without treating structural similarity as an open-world truth oracle.

知识图谱负采样生成模型嵌入学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。