arXiv:2504.00592cs.LG2025-04被引 22

用模块化拼接提升LUT神经网络精度与效率,适合部署在FPGA的边缘计算场景。

NeuraLUT-Assemble: Hardware-aware Assembling of Sub-Neural Networks for Efficient LUT Inference

  • 将小规模LUT单元组装成大连接神经元,解决输入过宽导致资源爆炸问题。
  • 在入侵检测、数字分类等任务上接近全连接模型精度,面积-延迟积降低8.42倍。
  • 引入跨LUT结构的跳跃连接,改善梯度传播,适合对低延迟敏感的硬件部署。

基于查找表(LUT)的高效神经网络在边缘计算场景中展现出巨大潜力,尤其适用于现场可编程门阵列(FPGA)上的新兴人工智能应用。这类架构可实现超低延迟和低资源占用,推动了粒子物理等领域对神经网络的采用。然而,现有设计因神经元输入宽度受限于LUT资源随输入维度呈指数增长,导致准确率下降。实践中,这一矛盾迫使研究者依赖极度稀疏的模型。本文提出NeuraLUT-Assemble框架,通过混合精度技术与小单元拼接大神经元的方式,在维持单个LUT输入数量可控的同时提升连接性,并引入跨整个LUT结构的跳跃连接以增强梯度流动。该方法弥合了基于LUT的方法与全连接(MLP)模型之间的准确率差距,在网络入侵检测、数字分类和喷注分类等任务上表现优异,相比发表时的最先进方案,面积-延迟积最高降低8.42倍。

原文摘要 · Abstract (English)

Efficient neural networks (NNs) leveraging lookup tables (LUTs) have demonstrated significant potential for emerging AI applications, particularly when deployed on field-programmable gate arrays (FPGAs) for edge computing. These architectures promise ultra-low latency and reduced resource utilization, broadening neural network adoption in fields such as particle physics. However, existing LUT-based designs suffer from accuracy degradation due to the large fan-in required by neurons being limited by the exponential scaling of LUT resources with input width. In practice, in prior work this tension has resulted in the reliance on extremely sparse models. We present NeuraLUT-Assemble, a novel framework that addresses these limitations by combining mixed-precision techniques with the assembly of larger neurons from smaller units, thereby increasing connectivity while keeping the number of inputs of any given LUT manageable. Additionally, we introduce skip-connections across entire LUT structures to improve gradient flow. NeuraLUT-Assemble closes the accuracy gap between LUT-based methods and (fully-connected) MLP-based models, achieving competitive accuracy on tasks such as network intrusion detection, digit classification, and jet classification, demonstrating up to $8.42\times$ reduction in the area-delay product compared to the state-of-the-art at the time of the publication.

FPGA部署LUT神经网络低延迟计算硬件感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。