arXiv:2602.05830cs.AIcs.LG2026-02被引 1

用更少的逻辑门实现高精度神经网络,适合嵌入式设备部署。

Learning Compact Boolean Networks

  • 提出无参数连接学习法,自动优化布尔网络结构。
  • 在标准视觉任务上,准确率更高且逻辑门数减少47倍。
  • 适用于FPGA等硬件,推理延迟低至6.48纳秒。

浮点神经网络虽主导现代机器学习,但推理开销大,促使研究转向布尔网络以应对资源受限场景。布尔网络仅使用布尔运算,可实现纳秒级推理延迟。然而,如何在保持紧凑性的同时实现高精度,仍是难题,因其具有离散、组合特性。本文提出三项互补创新:(i) 一种无需参数的高效连接学习策略;(ii) 一种利用空间局部性的紧凑卷积布尔架构,所需布尔操作少于现有卷积核;(iii) 自适应量化方法,减轻连续松弛网络转为离散布尔网络时的精度损失。在标准视觉基准上,本方法显著优于先前最先进方法,实现更高准确率且最多减少47倍布尔操作。该优势也扩展至其他模态。在FPGA上,对MNIST的模型达到99.38%准确率,延迟仅6.48纳秒,同时电路规模缩小7倍。代码与模型见https://github.com/eth-sri/CompactLogic。

原文摘要 · Abstract (English)

Floating-point neural networks dominate modern machine learning but incur substantial inference costs, motivating emerging interest in Boolean networks for resource-constrained deployments. Since Boolean networks use only Boolean operations, they can achieve nanosecond-scale inference latency. However, learning Boolean networks that are both compact and accurate remains challenging because of their discrete, combinatorial structure. In this work we address this challenge via three novel, complementary contributions: (i) a new parameter-free strategy for learning effective connections, (ii) a novel compact convolutional Boolean architecture that exploits spatial locality while requiring fewer Boolean operations than existing convolutional kernels, and (iii) an adaptive discretization procedure that reduces the accuracy drop incurred when converting a continuously relaxed network into a discrete Boolean network. Across standard vision benchmarks, our method improves the Pareto frontier over prior state-of-the-art methods, achieving higher accuracy with up to $47\times$ fewer Boolean operations. This advantage also extends to other modalities. Further, on an FPGA, our model on MNIST achieves 99.38\% accuracy with 6.48 ns latency, surpassing the prior state-of-the-art in both accuracy and runtime, while generating a $7\times$ smaller circuit. Code and models are available at https://github.com/eth-sri/CompactLogic.

布尔网络轻量化FPGA部署低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。