通过随机连接图间节点,提升图自监督学习性能
Enhancing Graph Self-Supervised Learning with Graph Interplay
- 在批次内引入随机跨图边,实现图间直接通信
- 在多个基准上显著超越现有自监督方法
- 可无缝集成到多种图学习模型中,适用性强
图自监督学习(GSSL)作为一种从图结构数据中提取信息表示的有力框架,减少了对标注数据的依赖。本文提出图互作(GIP),一种创新且通用的方法,能显著提升多种现有GSSL方法的性能。GIP通过在标准批次内引入随机跨图边,实现图级别的直接通信。理论上,我们证明了GIP本质上通过结合跨图消息传递与GSSL,实现了有原则的流形分离,从而生成更结构化的嵌入流形,有利于下游任务。实验表明,GIP在多个基准上显著超越主流GSSL方法,展现出突破性潜力。此外,GIP可轻松集成至多种GSSL方法,并持续带来性能提升。该进展不仅增强了GSSL的能力,也可能为更广泛的图学习范式奠定基础。
原文摘要 · Abstract (English)
Graph self-supervised learning (GSSL) has emerged as a compelling framework for extracting informative representations from graph-structured data without extensive reliance on labeled inputs. In this study, we introduce Graph Interplay (GIP), an innovative and versatile approach that significantly enhances the performance equipped with various existing GSSL methods. To this end, GIP advocates direct graph-level communications by introducing random inter-graph edges within standard batches. Against GIP's simplicity, we further theoretically show that \textsc{GIP} essentially performs a principled manifold separation via combining inter-graph message passing and GSSL, bringing about more structured embedding manifolds and thus benefits a series of downstream tasks. Our empirical study demonstrates that GIP surpasses the performance of prevailing GSSL methods across multiple benchmarks by significant margins, highlighting its potential as a breakthrough approach. Besides, GIP can be readily integrated into a series of GSSL methods and consistently offers additional performance gain. This advancement not only amplifies the capability of GSSL but also potentially sets the stage for a novel graph learning paradigm in a broader sense.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。