arXiv:2603.10033cs.CLcs.AI2026-03被引 2

新基准评估图模型在主题与格式双维度的迁移能力。

Evaluating Progress in Graph Foundation Models: A Comprehensive Benchmark and New Insights

  • 构建主题与格式双维评估框架,分离语义泛化与表示鲁棒性。
  • 在33个数据集上测试8个主流图基模型,揭示跨域迁移规律。
  • 适合关注图模型泛化性能与基准设计的研究者。

图基础模型(GFM)通过在多样化图上预训练获取可迁移知识,可适应多种下游任务。然而,图数据的领域偏移具有双重特性:不仅描述内容(主题域)不同,其表示形式(格式域)也存在差异。现有基准大多仅变化主题域,掩盖了知识在双维度间的迁移机制。本文提出新基准,全面评估从多域自监督预训练到少样本下游适配的全流程,涵盖七类主题域与六类格式域。通过四个控制场景评估:(i) 多主题多格式预训练后适配未知下游;(ii) 同预训练适配已知数据;(iii) 单主题预训练适配其他主题;(iv) 基础格式预训练适配其他格式。该双轴评估能解耦语义泛化与表示鲁棒性。我们在33个数据集上对8个先进GFM进行广泛评测,发现新经验规律并提供未来研究启示。代码与数据见https://github.com/smufang/GFMBenchmark。

原文摘要 · Abstract (English)

Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only in what they describe (topic domains) but also in how they are represented (format domains). Most existing GFM benchmarks vary only topic domains, thereby obscuring how knowledge transfers across both dimensions. We present a new benchmark that jointly evaluates topic and format gaps across the full GFM pipeline, including multi-domain self-supervised pre-training and few-shot downstream adaptation, and provides a timely evaluation of recent GFMs in the rapidly evolving landscape. Our protocol enables controlled assessment in four settings: (i) pre-training on diverse topics and formats, while adapting to unseen downstream datasets; (ii) same pre-training as in (i), while adapting to seen datasets; (iii) pre-training on a single topic domain, while adapting to other topics; (iv) pre-training on a base format, while adapting to other formats. This two-axis evaluation disentangles semantic generalization from robustness to representational shifts. We conduct extensive evaluations of eight state-of-the-art GFMs on 33 datasets spanning seven topic domains and six format domains, surfacing new empirical observations and practical insights for future research. Codes/data are available at https://github.com/smufang/GFMBenchmark.

图神经网络基准测试迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。