arXiv:2511.12340cs.LG2025-11被引 7

用可学习连接的逻辑门网络,实现高效低功耗硬件部署。

LILogic Net: Compact Logic Gate Networks with Learnable Connectivity for Efficient Hardware Deployment

  • 通过可微分拓扑结构与顶K连接机制,实现逻辑门网络的结构化稀疏训练。
  • 8000个逻辑门5分钟内完成MNIST训练,准确率达98.45%,性能媲美百倍规模模型。
  • 全二值化设计天然适配数字硬件,适合边缘设备与低功耗场景部署。

高效机器学习部署需考虑硬件约束。由于二元逻辑门是数字硬件的基本单元,直接基于逻辑运算构建的模型为高能效计算提供了可行路径。近期研究已证明逻辑门网络可通过梯度优化训练,且其连接关系可学习。但现有方法在可扩展性和训练效率上仍受限。本文将网络连接组视为可微对象,引入顶K连接机制,在训练中强制结构化稀疏性。由此提出的LILogicNet显著提升逻辑门网络效率:仅含8000个逻辑门的模型可在5分钟内完成MNIST训练,测试准确率达98.45%,性能媲美需100倍以上门数的先进模型。在更大规模下,256,000个逻辑门的模型在CIFAR-10上达到60.98%准确率,超越同等门数预算的先前方法。因最终模型完全二值化且仅由逻辑操作构成,推理计算开销极小,可自然映射至多种数字硬件平台,支持多样计算系统中的高效部署。

原文摘要 · Abstract (English)

Efficient machine learning deployment requires models that account for hardware constraints. Because binary logic gates are the fundamental primitives of digital hardware, models built directly from logic operations offer a promising path toward highly energy-efficient computation. Recent work has shown that networks of binary logic gates can be trained with gradient-based optimization and that their wiring can be learned. However, existing approaches remain limited in scalability and training efficiency. We address these challenges by treating the network connectome as a differentiable object and introducing a Top-K connectivity mechanism that enforces structured sparsity during training. Our resulting architecture, LILogicNet, substantially improves the efficiency of logic-gate networks. A model with only 8,000 gates trains on MNIST in under five minutes while achieving 98.45% test accuracy, matching the performance of state-of-the-art logic-gate models that require two orders of magnitude more gates. At larger scales, a 256,000-gate model achieves 60.98% test accuracy on CIFAR-10, surpassing prior approaches with comparable gate budgets. Because the final model is fully binarized and composed entirely of logic operations, inference incurs minimal compute overhead and maps naturally to a wide range of digital hardware platforms, enabling efficient deployment across diverse computing systems.

逻辑门网络硬件部署结构化稀疏低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。