统一训练框架让逻辑门神经网络在多硬件上高效部署并提升性能。
BitLogic: Training Framework for Gradient-Based FPGA-Native Neural Networks
- 构建五轴设计空间,统一多种逻辑神经网络的训练与评估流程。
- 新配置在多个数据集上超越所有已有方法,且在相同预算下表现最佳。
- 可在FPGA实现超高速推理,能效比比特打包GPU高4-5个数量级。
基于梯度的查找表和逻辑门神经网络(如LUTNet、LogicNets、DiffLogic等)用布尔查找替代乘加运算,同一训练模型可部署于GPU(位操作)、FPGA(LUT原语)和ASIC(标准单元门),均来自同一代码路径。然而每种方法各自拥有独立的训练流程、编码器、连接规则、扇入结构及硬件报告规范,导致从业者无法判断哪些设计选择影响精度、哪些影响硬件成本。本文发布 extbf{BitLogic},将该领域抽象为五轴设计空间(编码器、连接性、扇入、节点参数化、输出头),并在统一训练与评估协议下复现所有已有方法。框架不包含校准、剪枝、阈值等特定方法操作,所有实验限定于两层前馈网络。综合各轴最优配置,得到的新模型在MNIST、Fashion-MNIST、CIFAR-10和CIFAR-100上,于所有满足共享预算的(数据集,宽度)组合中,优于每个重新训练的先前方法。最佳配置模型在三种后端上验证:在MNIST上,两层网络在FPGA上达到约126百万样本/秒,相较比特打包GPU前向路径(每64位操作处理64样本)提速约15倍,同时功耗低四至五个数量级。
原文摘要 · Abstract (English)
Gradient-based LUT- and logic-gate-based neural networks (LUTNet, LogicNets, DiffLogic, PolyLUT, NeuraLUT, WARP-LUT, DWN, LILogicNet, LightLUT) replace multiply-accumulate arithmetic with Boolean lookups. The same trained checkpoint deploys to GPU as bitwise ops on bit-packed activations, to FPGA as LUT primitives, and to ASIC as standard-cell gates, all from one code path. Yet each method ships its own training pipeline, encoder, connectivity rule, fan-in, and hardware-reporting convention. The natural practitioner question, which of these choices actually matter for accuracy and which for hardware cost, therefore has no answer in the current literature. We release \textbf{BitLogic}, a unified framework that factors the field into a five-axis design space (encoder, connectivity, fan-in, node parameterization, head) and instantiates every prior method under one shared training and evaluation protocol. The framework deliberately omits method-specific procedures such as calibration, pruning, and thresholding, and all evaluations are limited to two-layer feed-forward networks. Combining the per-axis winners identifies a new best-of-space configuration that outperforms every retrained prior on every (dataset, width) cell in which every compared prior fits the shared budget, across MNIST, Fashion-MNIST, CIFAR-10, and CIFAR-100. We evaluate the best-of-space model on all three backends. On MNIST, the resulting two-layer network reaches ${\sim}126$\,MSamples/s on FPGA, ${\sim}15\times$ the throughput of a bit-packed GPU forward path that itself processes $64$ samples per $64$-bit operation, at four-to-five orders of magnitude less energy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。