GCoDE首次实现图神经网络在设备-边缘端的协同推理,显著提速省电。
GCoDE: Efficient Device-Edge Co-Inference for GNNs via Architecture-Mapping Co-Search
- 通过联合搜索模型架构与部署映射,自动优化设备-边缘协同推理
- 相比现有方法,最高提速44.9倍,能耗降低98.2%
- 适用于资源受限场景下的实时图学习应用
图神经网络(GNN)是当前最先进的图学习方法,但其在边缘设备上的高效推理面临巨大挑战,主要源于高计算开销与边缘硬件资源有限,难以满足实时性与能耗要求。作为新兴范式,设备-边缘协同推理有望提升效率并降低能耗。然而,针对GNN的协同推理研究仍很匮乏,且传统模型划分方法无效。为此,我们提出GCoDE,首个面向设备-边缘层级的GNN架构-映射协同设计与部署框架。通过将设备通信显式建模为操作,GCoDE在统一设计空间中融合架构与映射方案进行联合优化。同时,系统性能感知能力使其能有效评估异构系统下的架构效率。基于对各类GNN操作能耗的分析,GCoDE引入能量预测方法,提升能效评估精度并识别节能方案。采用基于约束的随机搜索策略,GCoDE可在1.5小时内找到平衡精度与效率的最优解。集成的协同推理引擎支持高效部署与执行。实验表明,GCoDE在多种应用场景与系统配置下,相较现有方法最高可实现44.9倍加速和98.2%能耗降低。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have emerged as the state-of-the-art graph learning method. However, achieving efficient GNN inference on edge devices poses significant challenges, limiting their application in real-world edge scenarios. This is due to the high computational cost of GNNs and limited hardware resources on edge devices, which prevent GNN inference from meeting real-time and energy requirements. As an emerging paradigm, device-edge co-inference shows potential for improving inference efficiency and reducing energy consumption on edge devices. Despite its potential, research on GNN device-edge co-inference remains scarce, and our findings show that traditional model partitioning methods are ineffective for GNNs. To address this, we propose GCoDE, the first automatic framework for GNN architecture-mapping Co-design and deployment on Device-Edge hierarchies. By abstracting the device communication process into an explicit operation, GCoDE fuses the architecture and mapping scheme in a unified design space for joint optimization. Additionally, GCoDE's system performance awareness enables effective evaluation of architecture efficiency across diverse heterogeneous systems. By analyzing the energy consumption of various GNN operations, GCoDE introduces an energy prediction method that improves energy assessment accuracy and identifies energy-efficient solutions. Using a constraint-based random search strategy, GCoDE identifies the optimal solution in 1.5 hours, balancing accuracy and efficiency. Moreover, the integrated co-inference engine in GCoDE enables efficient deployment and execution of GNN co-inference. Experimental results show that GCoDE can achieve up to 44.9x speedup and 98.2% energy reduction compared to existing approaches across diverse applications and system configurations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。