arXiv:2411.17063cs.LG2024-11KDD被引 10

用自监督学习提升图压缩的泛化能力,少标签也能用。

Contrastive Graph Condensation: Advancing Data Versatility through Self-Supervised Learning

  • 设计双分支结构,分别生成节点特征和图结构,解耦关键信息。
  • 引入对比损失交替优化,使压缩图在少标签下仍保持高性能。
  • 适合标签稀疏场景,对下游多种任务都有良好适应性。

随着大规模图上训练图神经网络(GNN)的计算开销增加,图压缩(GC)成为一种有前景的解决方案,即通过合成紧凑替代图来高效训练GNN。然而,现有方法多依赖分类作为代理任务,过度依赖节点标签,限制了其在标签稀疏场景下的应用。更严重的是,该任务容易使压缩图过拟合特定类别信息,削弱其在其他下游任务中的泛化能力。为此,我们提出对比图压缩(CTGC),采用自监督代理任务从原图中提取关键因果信息,增强压缩图的跨任务泛化能力。具体地,CTGC采用双分支框架,分离节点属性与图结构的生成过程,其中专门的结构分支通过节点位置嵌入显式编码几何信息。通过引入对比损失项并采用交替优化策略,促进两分支协同优化,结合模型反演技术实现高质量图生成。大量实验表明,CTGC在标签有限的情况下,对多种下游任务均表现优异,持续优于当前最先进的GC方法。

原文摘要 · Abstract (English)

With the increasing computation of training graph neural networks (GNNs) on large-scale graphs, graph condensation (GC) has emerged as a promising solution to synthesize a compact, substitute graph of the large-scale original graph for efficient GNN training. However, existing GC methods predominantly employ classification as the surrogate task for optimization, thus excessively relying on node labels and constraining their utility in label-sparsity scenarios. More critically, this surrogate task tends to overfit class-specific information within the condensed graph, consequently restricting the generalization capabilities of GC for other downstream tasks. To address these challenges, we introduce Contrastive Graph Condensation (CTGC), which adopts a self-supervised surrogate task to extract critical, causal information from the original graph and enhance the cross-task generalizability of the condensed graph. Specifically, CTGC employs a dual-branch framework to disentangle the generation of the node attributes and graph structures, where a dedicated structural branch is designed to explicitly encode geometric information through nodes' positional embeddings. By implementing an alternating optimization scheme with contrastive loss terms, CTGC promotes the mutual enhancement of both branches and facilitates high-quality graph generation through the model inversion technique. Extensive experiments demonstrate that CTGC excels in handling various downstream tasks with a limited number of labels, consistently outperforming state-of-the-art GC methods.

图神经网络图压缩自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。