用子图扩散模型做链接预测,能跨数据集迁移且抗攻击。
Sub-graph Based Diffusion Model for Link Prediction
- 将链接预测转为子图结构的条件概率估计,分步解耦结构与特征
- 无需重训练即可跨数据集迁移,小样本下仍具强泛化能力
- 对图对抗攻击鲁棒,适合需要可靠链接预测的场景
去噪扩散概率模型(DDPM)是当前性能卓越的生成模型,通过前向马尔可夫链逐步扰动数据,再由神经网络在反向过程中恢复原始数据。近年来,研究者开始探索其在图数据中的应用,但多数聚焦于生成任务。本文提出一种面向链接预测的新生成模型:将节点对之间的链接预测视为其包含子图的条件似然估计。通过贝叶斯公式精心设计分解似然估计过程,实现子图结构与节点特征的分离建模。该设计使模型兼具归纳学习优势与强大泛化能力。大量实验验证了该方法的显著优势:(1) 无需重新训练即可跨数据集迁移;(2) 在有限训练数据下表现优异;(3) 对图对抗攻击具有强鲁棒性。
原文摘要 · Abstract (English)
Denoising Diffusion Probabilistic Models (DDPMs) represent a contemporary class of generative models with exceptional qualities in both synthesis and maximizing the data likelihood. These models work by traversing a forward Markov Chain where data is perturbed, followed by a reverse process where a neural network learns to undo the perturbations and recover the original data. There have been increasing efforts exploring the applications of DDPMs in the graph domain. However, most of them have focused on the generative perspective. In this paper, we aim to build a novel generative model for link prediction. In particular, we treat link prediction between a pair of nodes as a conditional likelihood estimation of its enclosing sub-graph. With a dedicated design to decompose the likelihood estimation process via the Bayesian formula, we are able to separate the estimation of sub-graph structure and its node features. Such designs allow our model to simultaneously enjoy the advantages of inductive learning and the strong generalization capability. Remarkably, comprehensive experiments across various datasets validate that our proposed method presents numerous advantages: (1) transferability across datasets without retraining, (2) promising generalization on limited training data, and (3) robustness against graph adversarial attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。