首个大规模脉冲图神经网络综合评测基准,揭示能效瓶颈与设计规律
SGNNBench: A Holistic Evaluation of Spiking Graph Neural Network on Large-scale Graph
- 构建多维度评估框架,系统测试9种脉冲图网络在18个数据集上的表现
- 发现脉冲网络虽省电但存在隐性能效瓶颈,模型大小与内存占用影响显著
- 适合关注脑启发计算、低功耗图学习的科研人员参考
图神经网络(GNNs)通过消息传递机制有效捕捉图结构,在各类图任务中表现优异。然而,复杂架构在大规模图上已难持续,计算与时间开销巨大,亟需更节能的方案。脉冲图神经网络(SGNNs)利用基于脉冲的生物可解释神经元,以稀疏二值脉冲通信,降低计算与存储开销,成为有前景的节能替代方案。尽管近年涌现大量SGNN研究,但缺乏系统性基准来探索其在图数据上的设计原则。为此,我们提出SGNNBench,全面评估9个主流SGNN在18个数据集上的性能,涵盖有效性、能效与架构设计。实验对比了模型大小、内存使用及理论能耗,揭示了常被忽视的能效瓶颈。同时深入分析设计空间,推动通用SGNN范式的发展。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) are exemplary deep models designed for graph data. Message passing mechanism enables GNNs to effectively capture graph topology and push the performance boundaries across various graph tasks. However, the trend of developing such complex machinery for graph representation learning has become unsustainable on large-scale graphs. The computational and time overhead make it imperative to develop more energy-efficient GNNs to cope with the explosive growth of real-world graphs. Spiking Graph Neural Networks (SGNNs), which integrate biologically plausible learning via unique spike-based neurons, have emerged as a promising energy-efficient alternative. Different layers communicate with sparse and binary spikes, which facilitates computation and storage of intermediate graph representations. Despite the proliferation of SGNNs proposed in recent years, there is no systematic benchmark to explore the basic design principles of these brain-inspired networks on the graph data. To bridge this gap, we present SGNNBench to quantify progress in the field of SGNNs. Specifically, SGNNBench conducts an in-depth investigation of SGNNs from multiple perspectives, including effectiveness, energy efficiency, and architectural design. We comprehensively evaluate 9 state-of-the-art SGNNs across 18 datasets. Regarding efficiency, we empirically compare these baselines w.r.t model size, memory usage, and theoretical energy consumption to reveal the often-overlooked energy bottlenecks of SGNNs. Besides, we elaborately investigate the design space of SGNNs to promote the development of a general SGNN paradigm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。