统一多层级图表示学习,提升模型灵活性与性能。
A Unified Perspective for Learning Graph Representations Across Multi-Level Abstractions

- 融合节点、邻近、聚类、图级信息的统一对比框架
- 在多个数据集上优于当前最优方法,跨任务表现稳定
- 自适应加权机制无需调参,优化更精准
图自监督学习(GSSL)已成为生成图结构数据高质量表示的强大范式。尽管多尺度图对比学习受到关注,但多数方法仍集中于单一抽象层级。为此,我们提出一种统一对比框架,可同时捕获节点级、邻近级、聚类级和图级信息,并通过正样本相似度与负样本相似度(即异相似度)的线性组合进行整合。此外,现有方法通常对所有样本施加相同的惩罚强度,降低优化灵活性并导致收敛状态模糊。为此,我们引入一种无需参数的细粒度自加权机制,自适应地为每个相似度与异相似度评分分配权重,突出偏离目标值较大的得分。该方法不仅增强优化灵活性,还避免了传统多任务GSSL中调参带来的计算开销。在真实世界数据集上的全面实验表明,本方法在单层级与多层级场景下,均在分类、聚类和链接预测等下游任务中持续优于现有先进方法。
原文摘要 · Abstract (English)
Graph Self-Supervised Learning (GSSL) has emerged as a powerful paradigm for generating high-quality representations for graph-structured data. While multi-scale graph contrastive learning has received increasing attention, many existing methods still predominantly focus on a single graph abstraction level. To address this limitation, we propose a unified contrastive framework that can target node-level, proximity-level, cluster-level, and graph-level information and integrate them through a linear combination of similarity scores on positive pairs and dissimilarity scores (i.e., similarity scores on negative pairs). Furthermore, current approaches typically assign uniform penalty strengths to all examples, which reduces optimization flexibility and leads to ambiguous convergence status. To overcome this, we introduce a novel parameter-free fine-grained self-weighting mechanism that adaptively assigns weights to individual similarity and dissimilarity scores. The proposed mechanism emphasizes the scores that deviate significantly from their target values. Our approach not only enhances optimization flexibility but also eliminates the computational overhead of hyperparameter tuning in conventional multi-task GSSL methods. Comprehensive experiments on real-world datasets show that our methods consistently outperform state-of-the-art approaches across downstream tasks, including classification, clustering, and link prediction, in both single-level and multi-level scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。