ReInc让动态图神经网络训练提速十倍,解决大规模图数据效率难题。
ReInc: Scaling Training of Dynamic Graph Neural Networks
- 通过复用中间结果与增量聚合,减少重复计算
- 在真实图数据上实现比现有框架快10倍的训练速度
- 适合需要高效训练动态图模型的研究者与工程师
动态图神经网络(DGNN)因其在交通预测、疫情模拟和社交网络分析等领域的应用而受到广泛关注。本文提出ReInc系统,实现大规模图上DGNN的高效可扩展训练。ReInc利用GNN与RNN结合的特性,通过重用中间结果并增量计算连续图快照的聚合,显著提升计算效率。为此,系统引入两级缓存机制及适配DGNN工作流的缓存策略。同时,通过新型分布式训练策略,有效管理动态图中的结构与时间依赖性,消除远程特征访问和中间结果重分配带来的通信开销。实验表明,ReInc在多种DGNN架构和真实图数据集上相较现有最优框架提升达一个数量级的速度。
原文摘要 · Abstract (English)
Dynamic Graph Neural Networks (DGNNs) have gained widespread attention due to their applicability in diverse domains such as traffic network prediction, epidemiological forecasting, and social network analysis. In this paper, we present ReInc, a system designed to enable efficient and scalable training of DGNNs on large-scale graphs. ReInc introduces key innovations that capitalize on the unique combination of Graph Neural Networks (GNNs) and Recurrent Neural Networks (RNNs) inherent in DGNNs. By reusing intermediate results and incrementally computing aggregations across consecutive graph snapshots, ReInc significantly enhances computational efficiency. To support these optimizations, ReInc incorporates a novel two-level caching mechanism with a specialized caching policy aligned to the DGNN execution workflow. Additionally, ReInc addresses the challenges of managing structural and temporal dependencies in dynamic graphs through a new distributed training strategy. This approach eliminates communication overheads associated with accessing remote features and redistributing intermediate results. Experimental results demonstrate that ReInc achieves up to an order of magnitude speedup compared to state-of-the-art frameworks, tested across various dynamic GNN architectures and real-world graph datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。