arXiv:2506.06212cs.LG2025-06被引 1

用图生成模型指导对比学习,提升图表示性能。

Model-Driven Graph Contrastive Learning

  • 基于图论模型构建自适应数据增强策略
  • 在多个基准数据集上达到顶尖表现
  • 适合需要高质量图表示的研究者

我们提出一种模型驱动的图对比学习框架MGCL,利用图论(graphons,即图的概率生成模型)来指导对比学习,考虑数据背后的生成过程。图对比学习(GCL)已成为无需标注标签即可学习有表达力节点或图表示的强大自监督框架,在节点分类、图分类等下游任务中表现优异。然而,现有方法通常依赖人工设计或启发式增强策略,未针对底层数据分布,且仅在单个图层面操作,忽略了同源生成图之间的相似性。在本方法中,MGCL首先估计观测数据对应的图论模型,再据此定义图论引导的增强过程,实现数据自适应、理论严谨的增强。对于图级别任务,MGCL对数据集进行聚类,并为每组估计一个图论模型,使对比对反映共享语义与结构。大量实验表明,MGCL在多个基准数据集上达到当前最优性能,凸显将生成模型融入GCL的优势。

原文摘要 · Abstract (English)

We propose $\textbf{MGCL}$, a model-driven graph contrastive learning (GCL) framework that leverages graphons (probabilistic generative models for graphs) to guide contrastive learning by accounting for the data's underlying generative process. GCL has emerged as a powerful self-supervised framework for learning expressive node or graph representations without relying on annotated labels, which are often scarce in real-world data. By contrasting augmented views of graph data, GCL has demonstrated strong performance across various downstream tasks, such as node and graph classification. However, existing methods typically rely on manually designed or heuristic augmentation strategies that are not tailored to the underlying data distribution and operate at the individual graph level, ignoring similarities among graphs generated from the same model. Conversely, in our proposed approach, MGCL first estimates the graphon associated with the observed data and then defines a graphon-informed augmentation process, enabling data-adaptive and principled augmentations. Additionally, for graph-level tasks, MGCL clusters the dataset and estimates a graphon per group, enabling contrastive pairs to reflect shared semantics and structure. Extensive experiments on benchmark datasets demonstrate that MGCL achieves state-of-the-art performance, highlighting the advantages of incorporating generative models into GCL.

图神经网络对比学习生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。