让查表网络训练快100倍,自动优化硬件效率
HGQ-LUT: Fast LUT-Aware Training and Efficient Architectures for DNN Inference
- 用常规张量运算实现查表层,训练时高效
- 支持零比特剪枝,自动平衡精度与资源
- 适配FPGA部署,适合高实时性场景
基于查找表(LUT)的神经网络能在FPGA上实现超低延迟和优异硬件效率,通过将算术运算直接映射到逻辑原语。然而现有查表感知训练(LAT)方法训练速度慢、需人工调参且缺乏端到端流程。本文提出HGQ-LUT,集成于https://github.com/calad0i/HGQ2,可在现代GPU上使训练速度提升100倍以上,同时达到业界最优硬件效率。HGQ-LUT引入LUT-Dense和LUT-Conv层,训练时采用常规加速器友好的张量操作,推理时编译为逻辑LUT。结合细粒度元素级异构量化(含零比特剪枝)与查表感知资源代理,实现无需手动调参的精度-资源权衡探索。进一步集成至开源工具链,支持混合架构(LUT与传统算子共存)的统一设计、编译与位精确验证。该方案已应用于大型强子对撞机(CERN LHC)实验等实际场景。
原文摘要 · Abstract (English)
Lookup-table (LUT) based neural networks can deliver ultra-low latency and excellent hardware efficiency on FPGAs by mapping arithmetic operations directly onto the logic primitives. However, state-of-the-art LUT-aware training (LAT) approaches remain difficult to use in practice: they are often orders of magnitude slower to train than conventional networks, require non-trivial manual tuning for hardware efficiency, and lack an end-to-end workflow. This work presents HGQ-LUT, integrated in https://github.com/calad0i/HGQ2, a new LAT approach that achieves state-of-the-art hardware efficiency while accelerating training by over 100 times on modern GPUs. HGQ-LUT introduces LUT-Dense and LUT-Conv layers that are implemented with regular, accelerator-efficient tensor operations during training, which are then compiled into logic LUTs for hardware. By combining these layers with fine-grained, element-wise heterogeneous quantization (including zero-bit pruning) and a LUT-aware resource surrogate, HGQ-LUT enables the automatic exploration of accuracy-resource trade-offs without manual bit-width tuning. We further integrate HGQ-LUT into open-source toolchains, enabling unified design, compilation, and bit-exact verification of hybrid architectures that mix LUT-based with conventional arithmetic blocks. These features make LAT-based DNNs practical for real-world deployment, such as at the CERN Large Hadron Collider's experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。