提出GCCM模型,让图生成预测更稳定高效。
GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model

- 引入负样本对比学习,避免模型忽略噪声目标的捷径
- 在多个基准数据集上优于传统确定性预测器
- 适合需要高稳定性的图生成与预测任务
基于扩散的条件生成模型近年被用于图预测,通过建模给定输入图下的目标条件分布,表现媲美确定性预测器。然而,现有方法在推理时需昂贵的迭代去噪,且采样不稳定。尽管已有研究通过一致性训练减少去噪步骤并提升稳定性,但我们发现现有方法可能陷入捷径:模型通过忽略噪声目标(赋予其极低权重)来满足自一致性约束,最终退化为纯确定性预测器。为解决此问题,我们提出图对比一致性模型GCCM,超越传统的同一目标在不同噪声水平下的成对匹配,引入负样本以增加分离要求,使捷径不再成立。同时,对输入节点/边特征施加扰动,打破输入图的完全同质条件,使不同噪声水平下的预测不再一致,降低捷径吸引力。大量实验表明,GCCM有效缓解了捷径问题,在多个基准数据集上显著提升图预测性能。
原文摘要 · Abstract (English)
Conditional generative models, particularly diffusion-based methods, have recently been applied to graph prediction by modeling the target as a conditional distribution given the input graph, yielding competitive results compared to deterministic predictor. However, existing diffusion-based prediction methods typically require expensive iterative denoising at inference and often suffer from unstable sampling, which motivates recent efforts to reduce inference denoising steps and enable stable sampling via techniques such as consistency training. Despite this progress, we find that existing consistency training methods for graph prediction could potentially fall into a shortcut solution: the model may attempt to satisfy the self-consistency constraint by ignoring the noisy target (i.e., assigning it negligible weight), ultimately collapsing into a purely deterministic predictor. To mitigate such shortcut solution, we propose GCCM, a graph contrastive consistency model that goes beyond isolated pairwise matching between the same target at different noise levels by introducing negative pairs into a contrastive consistency objective. This adds an additional separation requirement, making the shortcut solution no longer trivially sufficient to satisfy the proposed objective. Moreover, we apply feature perturbation to the input node/edge features to break identical conditioning on the input graph, so that the shortcut no longer yields the same predictions across noise levels and becomes less attractive. Extensive experiments on benchmark datasets demonstrate that GCCM mitigates the shortcut solution and yields consistent performance improvements in graph prediction compared to deterministic predictors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。