arXiv:2501.01511cs.LGcs.AR2025-01中稿 · FPGA'25 conference被引 40

用梯度提升决策树替代神经网络,实现FPGA上高效推理。

TreeLUT: An Efficient Alternative to Deep Neural Networks for Inference Acceleration Using Gradient Boosted Decision Trees

  • 将决策树转为查找表,仅用LUT实现无乘法运算
  • 在多个数据集上达成低延迟、高吞吐且精度接近神经网络
  • 适合对功耗和延迟敏感的嵌入式部署场景

近年来,加速机器学习推理成为研究热点。现场可编程门阵列(FPGA)凭借其在深度神经网络(DNN)中的大规模并行性展现出优异性能。然而,神经网络推理计算密集,需大量乘加运算,导致硬件开销高。现有方法通过稀疏化、量化及将神经元或子网络转换为查找表(LUT)缓解此问题。梯度提升决策树(GBDT)在多种回归与分类任务中表现优异,尤其适用于表格数据。其基本单元为决策树,结构类似二进制决策图,而FPGA设计流程对此类结构高度优化。此外,GBDT推理仅涉及比较和加法等简单操作。本文提出开源工具TreeLUT,采用高效量化方案、硬件架构与流水线策略,完全基于LUT实现,无需片上块存储器(BRAM)或数字信号处理单元(DSP)。在多个常用分类数据集上的实验表明,相较于DWN、PolyLUT-Add、NeuraLUT、LogicNets、FINN、hls4ml等方法,TreeLUT在保持竞争力精度的同时,显著提升了硬件利用率、降低了延迟并提高了吞吐量。

原文摘要 · Abstract (English)

Accelerating machine learning inference has been an active research area in recent years. In this context, field-programmable gate arrays (FPGAs) have demonstrated compelling performance by providing massive parallelism in deep neural networks (DNNs). Neural networks (NNs) are computationally intensive during inference, as they require massive amounts of multiplication and addition, which makes their implementations costly. Numerous studies have recently addressed this challenge to some extent using a combination of sparsity induction, quantization, and transformation of neurons or sub-networks into lookup tables (LUTs) on FPGAs. Gradient boosted decision trees (GBDTs) are a high-accuracy alternative to DNNs in a wide range of regression and classification tasks, particularly for tabular datasets. The basic building block of GBDTs is a decision tree, which resembles the structure of binary decision diagrams. FPGA design flows are heavily optimized to implement such a structure efficiently. In addition to decision trees, GBDTs perform simple operations during inference, including comparison and addition. We present TreeLUT as an open-source tool for implementing GBDTs using an efficient quantization scheme, hardware architecture, and pipelining strategy. It primarily utilizes LUTs with no BRAMs or DSPs on FPGAs, resulting in high efficiency. We show the effectiveness of TreeLUT using multiple classification datasets, commonly used to evaluate ultra-low area and latency architectures. Using these benchmarks, we compare our implementation results with existing DNN and GBDT methods, such as DWN, PolyLUT-Add, NeuraLUT, LogicNets, FINN, hls4ml, and others. Our results show that TreeLUT significantly improves hardware utilization, latency, and throughput at competitive accuracy compared to previous works.

FPGA加速决策树查找表低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。