arXiv:2411.16342cs.LGcs.AR2024-11中稿 · ASP-DAC 2025被引 1

基于数据驱动的GNN推理调度方法,可精准预测最优数据流并提升性能。

A Data-Driven Approach to Dataflow-Aware Online Scheduling for Graph Neural Network Inference

  • 用合成图仿真训练回归模型,预测不同数据流下的推理延迟。
  • 对特定图的最优数据流预测准确率达91.28%,平均误差仅3.78%。
  • 在线调度算法实现最高3.17倍加速,适合高并发GNN推理场景。

图神经网络(GNN)在推荐系统、生物信息学和网络分析等领域展现出巨大潜力。然而,图数据的不规则性给高效计算带来挑战,催生了超越传统CPU和GPU性能的专用GNN加速架构。由于输入图结构多样,不同加速器在不同数据流下的表现差异显著,而这种由数据流与图特性共同决定的性能变化尚未被充分研究,限制了加速器的适应能力。为此,我们提出一种数据驱动的框架,用于数据流感知的GNN推理延迟预测。通过在合成图上进行仿真,训练回归模型以预测特定图在特定数据流下的执行延迟。实验表明,该回归模型对最优数据流的预测准确率高达91.28%,平均绝对百分比误差(MAPE)仅为3.78%。此外,我们设计了一种基于该模型的在线调度算法,用于优化调度决策。实验结果表明,该算法在所有数据集上相较最佳可行基线,平均完成时间提升达3.17倍,平均执行时间提升达6.26倍。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have shown significant promise in various domains, such as recommendation systems, bioinformatics, and network analysis. However, the irregularity of graph data poses unique challenges for efficient computation, leading to the development of specialized GNN accelerator architectures that surpass traditional CPU and GPU performance. Despite this, the structural diversity of input graphs results in varying performance across different GNN accelerators, depending on their dataflows. This variability in performance due to differing dataflows and graph properties remains largely unexplored, limiting the adaptability of GNN accelerators. To address this, we propose a data-driven framework for dataflow-aware latency prediction in GNN inference. Our approach involves training regressors to predict the latency of executing specific graphs on particular dataflows, using simulations on synthetic graphs. Experimental results indicate that our regressors can predict the optimal dataflow for a given graph with up to 91.28% accuracy and a Mean Absolute Percentage Error (MAPE) of 3.78%. Additionally, we introduce an online scheduling algorithm that uses these regressors to enhance scheduling decisions. Our experiments demonstrate that this algorithm achieves up to $3.17\times$ speedup in mean completion time and $6.26\times$ speedup in mean execution time compared to the best feasible baseline across all datasets.

GNN加速在线调度数据流优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。