不依赖对比学习的图表示框架,提升节点区分度与训练效率。
Predict, Cluster, Refine: A Joint Embedding Predictive Self-Supervised Framework for Graph Representation Learning
- 联合预测嵌入架构,无需负样本和对比损失
- 用高斯混合模型生成伪标签,增强语义区分能力
- 适合无标签场景下的高效图学习,性能超越主流方法
图表示学习在节点分类和链接预测等任务中至关重要,但现有自监督学习方法普遍存在计算效率低、依赖对比目标、表示崩溃等问题。传统方法常依赖特征重建、负采样或复杂解码器,增加训练开销并影响泛化能力。此外,现有技术未考虑无标签时节点嵌入对特定预测的贡献。为此,本文提出一种新的联合嵌入预测框架,消除对比目标与负采样,同时保留语义与结构信息。引入基于高斯混合模型(GMM)的语义感知目标,通过伪标签评估潜在特征贡献,提升节点可区分性。大量实验表明,该框架在多个基准上优于当前最优图自监督方法,无需对比损失或复杂解码器。核心创新包括:(1) 非对比、视角不变的联合嵌入预测架构;(2) 利用子图间的单上下文多目标关系;(3) 基于GMM的伪标签评分机制。该工作推动了图自监督学习的发展,提供了一种计算高效、抗崩溃的范式,有效融合空间与语义特征以支持下游任务。代码见:https://github.com/Deceptrax123/JPEB-GSSL
原文摘要 · Abstract (English)
Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on contrastive objectives, and representation collapse. Existing approaches often depend on feature reconstruction, negative sampling, or complex decoders, which introduce training overhead and hinder generalization. Further, current techniques which address such limitations fail to account for the contribution of node embeddings to a certain prediction in the absence of labeled nodes. To address these limitations, we propose a novel joint embedding predictive framework for graph SSL that eliminates contrastive objectives and negative sampling while preserving semantic and structural information. Additionally, we introduce a semantic-aware objective term that incorporates pseudo-labels derived from Gaussian Mixture Models (GMMs), enhancing node discriminability by evaluating latent feature contributions. Extensive experiments demonstrate that our framework outperforms state-of-the-art graph SSL methods across benchmarks, achieving superior performance without contrastive loss or complex decoders. Key innovations include (1) a non-contrastive, view-invariant joint embedding predictive architecture, (2) Leveraging single context and multiple targets relationship between subgraphs, and (3) GMM-based pseudo-label scoring to capture semantic contributions. This work advances graph SSL by offering a computationally efficient, collapse-resistant paradigm that bridges spatial and semantic graph features for downstream tasks. The code for our paper can be found at https://github.com/Deceptrax123/JPEB-GSSL
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。