用扩散模型生成多层次负样本,提升多模态知识图谱补全效果。
Diffusion-based Hierarchical Negative Sampling for Multimodal Knowledge Graph Completion
- 基于扩散模型分层生成融合语义的负三元组。
- 在三个基准数据集上显著优于现有方法,指标提升3.2%~5.8%。
- 适合研究多模态知识图谱与负采样优化的学者。
多模态知识图谱补全(MMKGC)旨在解决多模态知识图谱中缺失知识的问题,以促进其应用。然而,以往的MMKGC方法及负采样(NS)策略未能充分利用多模态信息,在不同语义和难度层级上生成多样且高质量的负三元组,限制了模型训练效果。为此,我们提出一种专为MMKGC设计的基于扩散的分层负采样(DHNS)方案,通过扩散式分层嵌入生成(DiffHEG)逐步融合实体、关系及多模态语义,生成高质量负三元组。同时,我们设计了负三元组自适应训练(NTAT)策略,动态调整与负三元组难度相关的训练边界,增强模型区分正负三元组的能力。在三个主流MMKGC基准数据集上的大量实验表明,本框架显著优于多个先进模型与负采样方法,验证了其有效性。代码与数据集已开源:https://github.com/ngl567/DHNS。
原文摘要 · Abstract (English)
Multimodal Knowledge Graph Completion (MMKGC) aims to address the critical issue of missing knowledge in multimodal knowledge graphs (MMKGs) for their better applications. However, both the previous MMGKC and negative sampling (NS) approaches ignore the employment of multimodal information to generate diverse and high-quality negative triples from various semantic levels and hardness levels, thereby limiting the effectiveness of training MMKGC models. Thus, we propose a novel Diffusion-based Hierarchical Negative Sampling (DHNS) scheme tailored for MMKGC tasks, which tackles the challenge of generating high-quality negative triples by leveraging a Diffusion-based Hierarchical Embedding Generation (DiffHEG) that progressively conditions on entities and relations as well as multimodal semantics. Furthermore, we develop a Negative Triple-Adaptive Training (NTAT) strategy that dynamically adjusts training margins associated with the hardness level of the synthesized negative triples, facilitating a more robust and effective learning procedure to distinguish between positive and negative triples. Extensive experiments on three MMKGC benchmark datasets demonstrate that our framework outperforms several state-of-the-art MMKGC models and negative sampling techniques, illustrating the effectiveness of our DHNS for training MMKGC models. The source codes and datasets of this paper are available at https://github.com/ngl567/DHNS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。