arXiv:2502.09263cs.LG2025-02ICML被引 34

简单改进的GNN在图分类任务中超越了复杂Transformer模型。

Can Classic GNNs Be Strong Baselines for Graph-level Tasks? Simple Architectures Meet Excellence

  • 用六种经典技术增强传统GNN,构建GNN+框架
  • 在14个数据集上,经典GNN性能超主流Graph Transformer
  • 速度快数倍,适合追求效率的图学习应用

消息传递图神经网络(GNN)常因表达能力有限、过平滑与过挤压等问题受到批评,而图注意力网络(GT)因其全局注意力机制被认为更具优势。现有研究普遍认为GT在小分子图的图分类与回归任务中优于GNN。本文通过一个增强框架GNN+,集成边特征融合、归一化、丢弃、残差连接、前馈网络和位置编码等六项常用技术,系统重评估三种经典GNN(GCN、GIN、GatedGCN)在14个标准图级数据集上的表现。结果表明,这些经过增强的GNN在所有数据集上均达到前三名,8个数据集排名第一,性能甚至超越现有GT模型;同时运行速度显著更快,快数倍。这挑战了复杂架构对优秀图级性能不可或缺的固有认知,凸显了简单结构的潜力。代码已开源:https://github.com/LUOyk1999/GNNPlus。

原文摘要 · Abstract (English)

Message-passing Graph Neural Networks (GNNs) are often criticized for their limited expressiveness, issues like over-smoothing and over-squashing, and challenges in capturing long-range dependencies. Conversely, Graph Transformers (GTs) are regarded as superior due to their employment of global attention mechanisms, which potentially mitigate these challenges. Literature frequently suggests that GTs outperform GNNs in graph-level tasks, especially for graph classification and regression on small molecular graphs. In this study, we explore the untapped potential of GNNs through an enhanced framework, GNN+, which integrates six widely used techniques: edge feature integration, normalization, dropout, residual connections, feed-forward networks, and positional encoding, to effectively tackle graph-level tasks. We conduct a systematic re-evaluation of three classic GNNs (GCN, GIN, and GatedGCN) enhanced by the GNN+ framework across 14 well-known graph-level datasets. Our results reveal that, contrary to prevailing beliefs, these classic GNNs consistently match or surpass the performance of GTs, securing top-three rankings across all datasets and achieving first place in eight. Furthermore, they demonstrate greater efficiency, running several times faster than GTs on many datasets. This highlights the potential of simple GNN architectures, challenging the notion that complex mechanisms in GTs are essential for superior graph-level performance. Our source code is available at https://github.com/LUOyk1999/GNNPlus.

图神经网络图分类模型效率GNN+

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。