arXiv:2410.15355cs.LGcs.AI2024-10

提出可学习的连续空间图增强方法,提升无监督节点表示质量

LAC: Graph Contrastive Learning with Learnable Augmentation in Continuous Space

  • 在正交连续空间中动态调整拓扑与特征增强
  • 新预训练任务使视图间信息一致性与多样性平衡
  • 在多个数据集上超越现有最优模型

图对比学习框架在生成高质量节点表示方面已取得成功。然而,针对高效数据增强方法和理想预训练任务的研究仍有限,导致无监督设置下节点表示性能不佳。本文提出LAC,一种在正交连续空间中进行可学习数据增强的图对比学习框架。为捕捉图数据中的代表性信息,引入连续视图增强器,分别采用掩码拓扑增强模块和跨通道特征增强模块,在正交连续空间中自适应地增强拓扑信息与特征信息。正交连续空间的特性避免了维度坍缩问题。为提升预训练任务有效性,提出基于信息论的原则InfoBal及相应预训练任务,使连续视图增强器在保持各视图间代表性信息一致性的同时最大化视图间差异性,从而让编码器在无监督设置下充分挖掘代表性信息。实验表明,LAC显著优于现有最先进框架。

原文摘要 · Abstract (English)

Graph Contrastive Learning frameworks have demonstrated success in generating high-quality node representations. The existing research on efficient data augmentation methods and ideal pretext tasks for graph contrastive learning remains limited, resulting in suboptimal node representation in the unsupervised setting. In this paper, we introduce LAC, a graph contrastive learning framework with learnable data augmentation in an orthogonal continuous space. To capture the representative information in the graph data during augmentation, we introduce a continuous view augmenter, that applies both a masked topology augmentation module and a cross-channel feature augmentation module to adaptively augment the topological information and the feature information within an orthogonal continuous space, respectively. The orthogonal nature of continuous space ensures that the augmentation process avoids dimension collapse. To enhance the effectiveness of pretext tasks, we propose an information-theoretic principle named InfoBal and introduce corresponding pretext tasks. These tasks enable the continuous view augmenter to maintain consistency in the representative information across views while maximizing diversity between views, and allow the encoder to fully utilize the representative information in the unsupervised setting. Our experimental results show that LAC significantly outperforms the state-of-the-art frameworks.

图神经网络对比学习数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。