首个图自监督学习迁移性基准,揭示多数方法泛化差,只有GraphMAE表现稳定。
GSTBench: A Benchmark Study on the Transferability of Graph Self-Supervised Learning
- 构建跨数据集的标准化评估框架,分离模型架构等干扰因素
- 在ogbn-papers100M上预训练,5种方法中多数迁移效果低于随机初始化
- GraphMAE作为掩码自编码器表现出持续提升,适合未来预训练研究
自监督学习(SSL)在图表示学习中展现出巨大潜力。然而,现有大多数图SSL方法仅在单一数据集上开发与评估,其跨数据集的迁移能力尚未被充分探索,限制了知识迁移和大规模预训练的应用,而这些对超越训练数据的通用智能至关重要。为填补这一空白并推动图基础模型研究,我们提出GSTBench,首个系统性的图SSL迁移性基准。我们在ogbn-papers100M上进行大规模预训练,并在多样化的目标图上评估五种代表性SSL方法。标准化实验设置解耦了模型架构、数据特征和适配协议等混淆因素,使比较聚焦于预训练目标本身。令人惊讶的是,多数图SSL方法难以泛化,部分甚至表现劣于随机初始化。相比之下,基于掩码自编码器的GraphMAE始终提升迁移性能。我们分析了驱动差异的深层因素,并为未来可迁移图SSL研究提供指导,为图学习中的‘预训练-迁移’范式奠定坚实基础。代码已开源。
原文摘要 · Abstract (English)
Self-supervised learning (SSL) has shown great promise in graph representation learning. However, most existing graph SSL methods are developed and evaluated under a single-dataset setting, leaving their cross-dataset transferability largely unexplored and limiting their ability to leverage knowledge transfer and large-scale pretraining, factors that are critical for developing generalized intelligence beyond fitting training data. To address this gap and advance foundation model research for graphs, we present GSTBench, the first systematic benchmark for evaluating the transferability of graph SSL methods. We conduct large-scale pretraining on ogbn-papers100M and evaluate five representative SSL methods across a diverse set of target graphs. Our standardized experimental setup decouples confounding factors such as model architecture, dataset characteristics, and adaptation protocols, enabling rigorous comparisons focused solely on pretraining objectives. Surprisingly, we observe that most graph SSL methods struggle to generalize, with some performing worse than random initialization. In contrast, GraphMAE, a masked autoencoder approach, consistently improves transfer performance. We analyze the underlying factors that drive these differences and offer insights to guide future research on transferable graph SSL, laying a solid foundation for the "pretrain-then-transfer" paradigm in graph learning. Our code is available at https://github.com/SongYYYY/GSTBench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。