arXiv:2507.02006cs.LG2025-07中稿 · ed

通过软硬件协同设计,显著加速图神经网络的外存稀疏矩阵乘法计算。

AIRES: Accelerating Out-of-Core GCNs via Algorithm-System Co-Design

  • 提出块级数据对齐与分块调度算法,优化稀疏矩阵计算效率。
  • 在真实图数据上实现最高1.8倍的延迟降低,提升计算吞吐量。
  • 适合大规模图神经网络部署,尤其适用于显存受限系统。

图卷积网络(GCNs)在生物医学蛋白质相互作用(PPI)到大规模推荐系统等众多科学应用中具有基础性作用。建模图结构的关键组件是稀疏通用矩阵-矩阵乘法(SpGEMM)。随着图数据规模持续扩大,由于资源受限系统的GPU显存有限,SpGEMM通常需采用外存方式执行。尽管已有研究通过GPU特征缓存、混合CPU-GPU内存布局或以稀疏格式计算来缓解外存内存瓶颈,但当前系统仍面临高I/O延迟和GPU利用率低的问题。本文首先识别出现有系统的主要瓶颈在于稀疏格式下的数据对齐与内存分配,提出AIRES——一种面向外存SpGEMM的新型算法-系统协同设计方案。算法层面,提出块级数据对齐策略并设计分块调度算法以实现行块对齐;系统层面,采用三阶段动态调度机制,结合层级内存系统(集成GPU显存、GPU Direct Storage(GDS)与主机内存),实现双向数据传输,有效降低I/O延迟并提升吞吐量。评估表明,AIRES在真实图处理基准测试中显著优于现有最先进方法,最高可降低1.8倍延迟。

原文摘要 · Abstract (English)

Graph convolutional networks (GCNs) are fundamental in various scientific applications, ranging from biomedical protein-protein interactions (PPI) to large-scale recommendation systems. An essential component for modeling graph structures in GCNs is sparse general matrix-matrix multiplication (SpGEMM). As the size of graph data continues to scale up, SpGEMMs are often conducted in an out-of-core fashion due to limited GPU memory space in resource-constrained systems. Albeit recent efforts that aim to alleviate the memory constraints of out-of-core SpGEMM through either GPU feature caching, hybrid CPU-GPU memory layout, or performing the computation in sparse format, current systems suffer from both high I/O latency and GPU under-utilization issues. In this paper, we first identify the problems of existing systems, where sparse format data alignment and memory allocation are the main performance bottlenecks, and propose AIRES, a novel algorithm-system co-design solution to accelerate out-of-core SpGEMM computation for GCNs. Specifically, from the algorithm angle, AIRES proposes to alleviate the data alignment issues on the block level for matrices in sparse formats and develops a tiling algorithm to facilitate row block-wise alignment. On the system level, AIRES employs a three-phase dynamic scheduling that features a dual-way data transfer strategy utilizing a tiered memory system: integrating GPU memory, GPU Direct Storage (GDS), and host memory to reduce I/O latency and improve throughput. Evaluations show that AIRES significantly outperforms the state-of-the-art methods, achieving up to 1.8x lower latency in real-world graph processing benchmarks.

图神经网络稀疏计算系统优化外存计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。