用FPGA实现可扩展的神经符号AI加速,效率远超传统硬件。
NSFlow: An End-to-End FPGA Framework with Scalable Dataflow Architecture for Neuro-Symbolic AI
- 基于FPGA构建可重构数据流架构,自动优化计算与内存布局。
- 相比Jetson TX2提升31倍速度,符号计算扩展150倍仅增4倍耗时。
- 适合需要实时推理和高可解释性的下一代认知系统开发者。
神经符号AI(NSAI)是融合神经网络与符号推理的新兴范式,能提升AI系统的透明性、推理能力与数据效率。尽管算法表现优异,现有硬件(如CPU、GPU、TPU)难以高效执行NSAI任务,因其异构计算核、高内存需求及独特访问模式。当前算法在操作类型与规模上差异大,不兼容现有机器学习加速器。为此,本文提出NSFlow——首个面向NSAI的端到端FPGA加速框架。其包含数据依赖分析驱动的架构生成器,以及支持灵活计算单元、可重组内存与混合精度的可重构阵列。评估显示,NSFlow相较Jetson TX2提速31倍,超过GPU两倍,比类似脉动阵列的TPU快8倍,优于Xilinx DPU三倍以上;当符号任务规模扩大150倍时,运行时间仅增加4倍,展现出卓越可扩展性。据我们所知,这是首个实现通用可泛化NSAI算法实时加速的框架,为下一代认知系统提供有力解决方案。
原文摘要 · Abstract (English)
Neuro-Symbolic AI (NSAI) is an emerging paradigm that integrates neural networks with symbolic reasoning to enhance the transparency, reasoning capabilities, and data efficiency of AI systems. Recent NSAI systems have gained traction due to their exceptional performance in reasoning tasks and human-AI collaborative scenarios. Despite these algorithmic advancements, executing NSAI tasks on existing hardware (e.g., CPUs, GPUs, TPUs) remains challenging, due to their heterogeneous computing kernels, high memory intensity, and unique memory access patterns. Moreover, current NSAI algorithms exhibit significant variation in operation types and scales, making them incompatible with existing ML accelerators. These challenges highlight the need for a versatile and flexible acceleration framework tailored to NSAI workloads. In this paper, we propose NSFlow, an FPGA-based acceleration framework designed to achieve high efficiency, scalability, and versatility across NSAI systems. NSFlow features a design architecture generator that identifies workload data dependencies and creates optimized dataflow architectures, as well as a reconfigurable array with flexible compute units, re-organizable memory, and mixed-precision capabilities. Evaluating across NSAI workloads, NSFlow achieves 31x speedup over Jetson TX2, more than 2x over GPU, 8x speedup over TPU-like systolic array, and more than 3x over Xilinx DPU. NSFlow also demonstrates enhanced scalability, with only 4x runtime increase when symbolic workloads scale by 150x. To the best of our knowledge, NSFlow is the first framework to enable real-time generalizable NSAI algorithms acceleration, demonstrating a promising solution for next-generation cognitive systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。