分离检索与重排序,提升多模态知识图谱补全精度
RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion

- 用关系感知嵌入检索器和条件离散去噪器解耦检索与重排序
- 在三个基准上超越强基线,最佳结果提升1.8~3.2个点
- 适合需要高召回率场景的多模态知识推理任务
多数多模态知识图谱补全(MMKGC)模型使用单一嵌入评分器同时完成全实体集检索与最终链接预测。我们认为这种耦合是核心瓶颈:全局高召回搜索与局部细粒度消歧需要不同归纳偏置。因此,我们提出检索增强的离散扩散框架(RADD),解耦检索与重排序。一个关系感知的多模态知识图嵌入(KGE)检索器作为全局检索器与知识蒸馏教师,而条件离散去噪器在候选短列表层面生成实体身份用于重排序。训练结合KGE监督、去噪交叉熵及检索器到去噪器的温度缩放蒸馏。推理时,设计的Diff-Rerank先用检索器生成前K名短列表,再由去噪器重排序,确保召回率是精度的前提。在三个MMKGC基准上的实验表明,RADD性能最优,持续优于强基线,包括单模态、多模态及基于大语言模型的方法;消融实验证明各组件均有贡献。
原文摘要 · Abstract (English)
Most multi-modal knowledge graph completion (MMKGC) models use one embedding scorer to conduct both retrieval over the full entity set and final link prediction. We argue that this coupling is a core bottleneck: global high-recall search and local fine-grained disambiguation require different inductive biases. Therefore, we propose a Retrieval-Augmented Discrete Diffusion (RADD) framework to decouple retrieval and reranking for MMKGC. A relation-aware multimodal knowledge graph embedding (KGE) retriever serves as both global retriever and distillation teacher, while a conditional discrete denoiser performs shortlist-level entity-identity generation for reranking. Training combines KGE supervision, denoising cross-entropy, and temperature-scaled distillation from the retriever to the denoiser. At inference, the designed Diff-Rerank first forms a top-K shortlist with the retriever and then reranks it with the denoiser, ensuring that recall is a strict requirement for precision. Experiments on three MMKGC benchmarks show that RADD achieves the best performance and consistent gains over strong unimodal, multimodal, and LLM-based baselines, while ablations further verify each component's contribution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。