arXiv:2501.12032cs.ARcs.DC2025-01被引 2

用FPGA+GPU流水线加速推荐系统数据处理,吞吐提升超10倍。

Accelerating Recommender Model ETL with a Streaming FPGA-GPU Dataflow

  • 设计训练感知的FPGA数据流,实现数据预处理与训练并行
  • 通过P2P直传零拷贝将数据送入GPU内存,提升效率
  • 适合大规模在线推荐系统,降低计算成本

推荐模型的实时性能依赖于持续将大量新用户行为数据集成到训练流水线中。尽管GPU已显著提升模型训练吞吐量,但数据预处理阶段(通常为提取-转换-加载,ETL)已成为主要瓶颈。生产系统常需部署多个CPU服务器支持单个GPU节点,导致运营成本高昂。为此,我们提出PipeRec,一种与在线推荐模型训练协同设计的硬件加速ETL引擎。PipeRec引入训练感知的ETL抽象,支持数据新鲜度、顺序性和批处理语义,并将软件定义的操作编译为可重构的FPGA数据流;同时在I/O受限条件下,通过重叠ETL与GPU训练以最大化利用率。为消除CPU瓶颈,PipeRec实现格式感知打包器,通过P2P DMA直接将就绪批次流式传输至GPU内存,实现零拷贝摄入和高效GPU使用。在三个数据集上的评估显示,相比基于CPU的管道,PipeRec使ETL吞吐提升超过10倍,比现有最先进GPU ETL系统最高提升17倍;集成训练后,保持64%-91%的GPU利用率,端到端训练时间仅为传统CPU-GPU管道的9.94%。

原文摘要 · Abstract (English)

The real-time performance of recommender models depends on the continuous integration of massive volumes of new user interaction data into training pipelines. While GPUs have scaled model training throughput, the data preprocessing stage - commonly expressed as Extract-Transform-Load (ETL) pipelines - has emerged as the dominant bottleneck. Production systems often dedicate clusters of CPU servers to support a single GPU node, leading to high operational cost. To address this issue, we present PipeRec, a hardware-accelerated ETL engine co-designed with online recommender model training. PipeRec introduces a training-aware ETL abstraction that exposes freshness, ordering, and batching semantics while compiling software-defined operators into reconfigurable FPGA dataflows and overlaps ETL with GPU training to maximize utilization under I/O constraints. To eliminate CPU bottlenecks, PipeRec implements a format-aware packer that streams training-ready batches directly into GPU memory via P2P DMA transfers, enabling zero-copy ingest and efficient GPU consumption. Our evaluation on three datasets shows that PipeRec accelerates ETL throughput by over 10x compared to CPU-based pipelines and up to 17x over state-of-the-art GPU ETL systems. When integrated with training, PipeRec maintains 64-91% GPU utilization and reduces end-to-end training time to 9.94% of the time taken by CPU-GPU pipelines.

推荐系统FPGA加速数据流水线GPU优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。