arXiv:2508.21739cs.LGcs.AI2025-08被引 2

在FPGA上实现实时神经网络加速,降低高能物理数据处理延迟。

Neural Network Acceleration on MPSoC board: Integrating SLAC's SNL, Rogue Software and Auto-SNL

  • 通过SNL框架实现FPGA上模型权重动态更新,无需重新综合。
  • 相比hls4ml,多数架构下延迟更低,部分场景节省硬件资源。
  • 适合高能物理、医学成像等需实时数据压缩的领域研究者使用。

LCLS-II自由电子激光器每秒可生成高达1兆赫兹的X射线脉冲,探测器数据吞吐量超过1TB/s。如此巨大的数据流使传输与存储成本急剧上升。机器学习可提供实时数据压缩方案,但传统实现方式延迟过高,难以满足高速实验环境需求。为此,SLAC开发了专用的SLAC神经网络库(SNL),可在现场可编程门阵列(FPGA)上部署实时推理模型。SNL的核心优势在于无需重新综合即可动态更新模型权重,支持自适应学习应用。为进一步提升易用性,本文提出Auto-SNL——一个将Python神经网络模型自动转换为SNL兼容高层次综合代码的Python扩展。在Xilinx ZCU102 FPGA上对多种神经网络结构、定点精度和综合配置进行基准测试,结果表明:在多数架构中,SNL达到或优于hls4ml的延迟表现,部分情况下还可节省FPGA资源。该适配展示了SNL的通用性,为高能物理、医学成像、机器人等领域研究人员开辟新可能。

原文摘要 · Abstract (English)

The LCLS-II Free Electron Laser (FEL) will generate X-ray pulses for beamline experiments at rates of up to 1~MHz, with detectors producing data throughputs exceeding 1 TB/s. Managing such massive data streams presents significant challenges, as transmission and storage infrastructures become prohibitively expensive. Machine learning (ML) offers a promising solution for real-time data reduction, but conventional implementations introduce excessive latency, making them unsuitable for high-speed experimental environments. To address these challenges, SLAC developed the SLAC Neural Network Library (SNL), a specialized framework designed to deploy real-time ML inference models on Field-Programmable Gate Arrays (FPGA). SNL's key feature is the ability to dynamically update model weights without requiring FPGA resynthesis, enhancing flexibility for adaptive learning applications. To further enhance usability and accessibility, we introduce Auto-SNL, a Python extension that streamlines the process of converting Python-based neural network models into SNL-compatible high-level synthesis code. This paper presents a benchmark comparison against hls4ml, the current state-of-the-art tool, across multiple neural network architectures, fixed-point precisions, and synthesis configurations targeting a Xilinx ZCU102 FPGA. The results showed that SNL achieves competitive or superior latency in most tested architectures, while in some cases also offering FPGA resource savings. This adaptation demonstrates SNL's versatility, opening new opportunities for researchers and academics in fields such as high-energy physics, medical imaging, robotics, and many more.

FPGA加速实时推理神经网络部署高能物理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。