arXiv:2409.07725cs.LGcs.AI2024-09被引 7

通过多维对比学习提升图嵌入,无需大量标注数据即可更好捕捉局部与全局结构。

GRE^2-MDCL: Graph Representation Embedding Enhanced via Multidimensional Contrastive Learning

  • 设计三网络架构,结合SVD与LAGNN进行图的全局与局部增强
  • 在Cora、Citeseer、PubMed上分别达到82.5%、72.5%、81.6%准确率
  • 适合缺乏标签数据的图学习场景,如社交网络分析与知识图谱

图表示学习已成为在映射节点至向量表示时保留图拓扑结构的强大工具,支持节点分类和社区发现等下游任务。然而,当前多数图神经网络模型需依赖大量标注数据,限制了其在真实世界中标签稀缺场景的应用。为此,研究者探索了图对比学习(GCL),利用增强图数据与对比学习技术。尽管前景广阔,现有GCL方法常难以有效捕捉局部与全局图结构,并平衡节点级与图级表示之间的权衡。本文提出图表示嵌入增强的多维对比学习方法(GRE2-MDCL)。该模型采用新颖的三网络架构,以多头注意力GNN为核心。首先,通过奇异值分解(SVD)与局部自适应图神经网络(LAGNN)对输入图进行全局与局部增强。随后,构建包含跨网络、跨视图与邻域对比的多维对比损失,优化模型。在基准数据集Cora、Citeseer与PubMed上的大量实验表明,GRE2-MDCL实现领先性能,平均准确率分别为82.5%、72.5%与81.6%。可视化结果进一步显示更紧密的簇内聚集与更清晰的簇间边界,验证了框架在改进基线GCL模型方面的有效性。

原文摘要 · Abstract (English)

Graph representation learning has emerged as a powerful tool for preserving graph topology when mapping nodes to vector representations, enabling various downstream tasks such as node classification and community detection. However, most current graph neural network models face the challenge of requiring extensive labeled data, which limits their practical applicability in real-world scenarios where labeled data is scarce. To address this challenge, researchers have explored Graph Contrastive Learning (GCL), which leverages enhanced graph data and contrastive learning techniques. While promising, existing GCL methods often struggle with effectively capturing both local and global graph structures, and balancing the trade-off between nodelevel and graph-level representations. In this work, we propose Graph Representation Embedding Enhanced via Multidimensional Contrastive Learning (GRE2-MDCL). Our model introduces a novel triple network architecture with a multi-head attention GNN as the core. GRE2-MDCL first globally and locally augments the input graph using SVD and LAGNN techniques. It then constructs a multidimensional contrastive loss, incorporating cross-network, cross-view, and neighbor contrast, to optimize the model. Extensive experiments on benchmark datasets Cora, Citeseer, and PubMed demonstrate that GRE2-MDCL achieves state-of-the-art performance, with average accuracies of 82.5%, 72.5%, and 81.6% respectively. Visualizations further show tighter intra-cluster aggregation and clearer inter-cluster boundaries, highlighting the effectiveness of our framework in improving upon baseline GCL models.

图神经网络对比学习无监督学习嵌入优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。