用能量对比学习优化图结构,提升GNN的鲁棒性和分类性能。
Graph Structure Refinement with Energy-based Contrastive Learning
- 基于能量对比学习,通过正负样本相似度调整图结构。
- 在8个基准数据集上超越现有方法,训练更快更省资源。
- 适合需要高效图结构优化的下游任务应用。
图神经网络(GNN)在分析图结构数据方面表现优异,但噪声边导致的不完美图结构会降低模型鲁棒性,影响实际任务表现。现有生成模型难以适配判别型图任务。为此,本文提出一种无监督联合生成与判别训练方法,构建能量-对比学习引导的图结构精炼框架(ECL-GSR),首次将能量模型与对比学习结合用于图结构精炼。通过拟合样本对的联合分布,增强正样本表示相似度,降低负样本相似度,并根据节点表示相似度增删边以优化结构。大量实验表明,ECL-GSR在8个基准数据集的节点分类任务中均优于当前最优方法,且在少样本、低内存条件下实现更快训练,体现其简洁高效性。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have recently gained widespread attention as a successful tool for analyzing graph-structured data. However, imperfect graph structure with noisy links lacks enough robustness and may damage graph representations, therefore limiting the GNNs' performance in practical tasks. Moreover, existing generative architectures fail to fit discriminative graph-related tasks. To tackle these issues, we introduce an unsupervised method based on a joint of generative training and discriminative training to learn graph structure and representation, aiming to improve the discriminative performance of generative models. We propose an Energy-based Contrastive Learning (ECL) guided Graph Structure Refinement (GSR) framework, denoted as ECL-GSR. To our knowledge, this is the first work to combine energy-based models with contrastive learning for GSR. Specifically, we leverage ECL to approximate the joint distribution of sample pairs, which increases the similarity between representations of positive pairs while reducing the similarity between negative ones. Refined structure is produced by augmenting and removing edges according to the similarity metrics among node representations. Extensive experiments demonstrate that ECL-GSR outperforms the state-of-the-art on eight benchmark datasets in node classification. ECL-GSR achieves faster training with fewer samples and memories against the leading baseline, highlighting its simplicity and efficiency in downstream tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。