Taurus加速百亿规模图神经网络推理,显著降低内存与磁盘开销。
Taurus: Accelerating Out-of-Core Graph Neural Network Inference on Billion-Scale Graphs

- 通过源中心广播和顺序SSD扫描,减少重复读取
- 在2.69亿顶点、40亿边的图上比基线快7-25倍
- 适合单机部署的大规模图推理,尤其高连接度节点
在百亿规模图上进行图神经网络(GNN)推理面临特征与嵌入占用大量内存、外存设置下磁盘I/O成本高的挑战。现有分布式系统通信开销大,而基于磁盘的系统主要面向训练,推理时存在大量冗余读取。本文提出Taurus,一种支持精确全图推理与采样推理的单机系统。它将逐层推理重构为基于顺序SSD扫描的源中心广播,结合流水线式GPU-CPU-SSD架构、拓扑感知重排、待处理消息淘汰机制及高阶顶点的GPU驻留存储,有效避免随机重复特征获取。同时采用非缓冲顺序读取与GPU后端写入,减少页缓存污染、主机内存压力与写入开销。在包含最多26900万顶点、40亿边、514吉字节特征的外存图上,Taurus相较最强逐层基线DGI提升7-25倍,相比顶点级基线提升40-140倍。
原文摘要 · Abstract (English)
Graph Neural Network (GNN) inference on billion-scale graphs is challenging due to the large memory footprint of features and embeddings and high disk I/O costs in out-of-core settings. Existing distributed GNN systems incur high communication times and infrastructure costs, while disk-based GNN systems are primarily tailored to training and experience massive wasted reads during inference on the entire graph. We present Taurus, a single-machine system for GNN inference on graphs that do not fit in RAM, supporting both \textit{exact} full-graph inference and fanout-sampled inference. To avoid random and repeated feature gathers, Taurus reformulates layer-wise inference as source-centric broadcasts over sequential SSD scans, backed by a pipelined GPU-CPU-SSD hierarchy, topology-aware reordering, pending-message eviction, and a GPU-resident store for high-degree vertices. It further uses non-buffered sequential reads and GPU-backed writes to reduce page-cache pollution, host-memory pressure, and write overheads. On out-of-core graphs with up to $269M$ vertices, $4B$ edges, and $514$ GiB of features, Taurus outperforms the strongest layer-wise baseline, DGI, by $7$-$25\times$, and vertex-wise baselines by $40$-$140\times$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。