用图粗化技术加速图神经网络推理,让小设备也能高效运行。
FIT-GNN: Faster Inference Time for GNNs that 'FIT' in Memory Using Coarsening
- 通过节点合并与聚类实现图粗化,降低推理计算量。
- 单节点推理速度提升数个数量级,内存占用大幅减少。
- 适合在资源受限设备上部署图分类与回归模型。
图神经网络(GNN)的可扩展性仍是重大挑战。尽管已有方法如图粗化、凝聚和计算树可在更小图上训练以加快计算,但以往研究未充分关注推理阶段的计算开销。本文提出一种新方法,通过图粗化显著降低推理阶段的计算负担。我们设计了两种策略:额外节点法与聚类节点法,拓展了图粗化在图级别任务(如图分类与图回归)中的应用。在多个基准数据集上进行了大量实验,结果表明,该方法相比传统方法实现推理时间数个数量级的提升,同时显著降低节点与图分类、回归任务的内存消耗,使低资源设备上的高效训练与推理成为可能。值得注意的是,这些计算优势在保持与基线模型相当性能的前提下实现。
原文摘要 · Abstract (English)
Scalability of Graph Neural Networks (GNNs) remains a significant challenge. To tackle this, methods like coarsening, condensation, and computation trees are used to train on a smaller graph, resulting in faster computation. Nonetheless, prior research has not adequately addressed the computational costs during the inference phase. This paper presents a novel approach to improve the scalability of GNNs by reducing computational burden during the inference phase using graph coarsening. We demonstrate two different methods -- Extra Nodes and Cluster Nodes. Our study extends the application of graph coarsening for graph-level tasks, including graph classification and graph regression. We conduct extensive experiments on multiple benchmark datasets to evaluate the performance of our approach. Our results show that the proposed method achieves orders of magnitude improvements in single-node inference time compared to traditional approaches. Furthermore, it significantly reduces memory consumption for node and graph classification and regression tasks, enabling efficient training and inference on low-resource devices where conventional methods are impractical. Notably, these computational advantages are achieved while maintaining competitive performance relative to baseline models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。