用扩散模型一次性生成知识图谱缺失三元组,兼顾一致性与效率。
One Pass for All: A Discrete Diffusion Model for Knowledge Graph Triple Set Prediction

- 将三元组预测视为生成任务,通过离散扩散过程逐步加噪与去噪。
- 在三个公开数据集上达到当前最佳性能,一次生成全部缺失三元组。
- 结构感知去噪网络融合关系上下文与图扩散机制,捕捉三元组依赖关系。
知识图谱由三元组构成,知识图谱补全(KGC)的目标是推断缺失的事实三元组。传统KGC任务在已知一个或两个元素的情况下预测缺失部分,而更贴近现实的三元组集合预测(TSP)任务仅基于可观测知识图谱,不假设任何缺失三元组的信息。现有TSP方法逐个预测三元组,难以捕捉预测结果间的依赖关系以保证一致性。为此,我们提出一种新的离散扩散模型DiffTSP,将TSP视为生成任务。DiffTSP通过掩码关系边实现知识图谱的离散扩散过程,反向过程则在不完整图条件下逐步恢复完整图谱。为此,我们设计了结构感知去噪网络,结合关系上下文编码器与关系图扩散变压器,用于知识图谱生成。DiffTSP能以单次遍历生成完整三元组集合,同时确保预测间的依赖一致性。该方法在三个公开数据集上取得当前最优性能。代码已开源:https://github.com/ADMIS-TONGJI/DiffTSP。
原文摘要 · Abstract (English)
Knowledge Graphs (KGs) are composed of triples, and the goal of Knowledge Graph Completion (KGC) is to infer the missing factual triples. Traditional KGC tasks predict missing elements in a triple given one or two of its elements. As a more realistic task, the Triple Set Prediction (TSP) task aims to infer the set of missing triples conditioned only on the observed knowledge graph, without assuming any partial information about the missing triples. Existing TSP methods predict the set of missing triples in a triple-by-triple manner, falling short in capturing the dependencies among the predicted triples to ensure consistency. To address this issue, we propose a novel discrete diffusion model termed DiffTSP that treats TSP as a generative task. DiffTSP progressively adds noise to the KG through a discrete diffusion process, achieved by masking relational edges. The reverse process then gradually recovers the complete KG conditioned on the incomplete graph. To this end, we design a structure-aware denoising network that integrates a relational context encoder with a relational graph diffusion transformer for knowledge graph generation. DiffTSP can generate the complete set of triples in a one-pass manner while ensuring the dependencies among the predicted triples. Our approach achieves state-of-the-art performance on three public datasets. Code: https://github.com/ADMIS-TONGJI/DiffTSP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。