将可微逻辑门网络映射到硅芯片,实现高速低功耗图像分类。
Silicon Aware Neural Networks
- 将训练好的神经网络转为门级网表,一对一映射到CMOS标准单元库。
- 新损失函数优化每神经元面积,间接降低电路功耗。
- 首次在130nm工艺中仿真实现,每秒处理4180万次,仅耗电83.88mW。
近期研究显示,深度学习可训练由离散逻辑门构成的神经网络,在CPU、GPU和FPGA上以极高速度完成简单图像分类任务。由于采用离散逻辑门构建,这些可微逻辑门网络(DLGNs)天然适合定制硅实现。本文提出一种方法,将训练好的DLGN通过转换为门级网表,一对一映射至数字CMOS标准单元库。同时,我们设计了一种新型损失函数,使DLGN能基于目标标准单元库中各单元面积,最小化每神经元的期望面积,从而间接优化电路面积与功耗。此外,首次在仿真中实现了DLGN的硅电路:使用Cadence标准单元库,在SkyWater 130nm工艺下布局为自定义硬宏,并完成版图后功耗分析。结果表明,该定制宏可在MNIST数据集上实现97%准确率,每秒执行4180万次分类,功耗仅为83.88mW。
原文摘要 · Abstract (English)
Recent work in the machine learning literature has demonstrated that deep learning can train neural networks made of discrete logic gate functions to perform simple image classification tasks at very high speeds on CPU, GPU and FPGA platforms. By virtue of being formed by discrete logic gates, these Differentiable Logic Gate Networks (DLGNs) lend themselves naturally to implementation in custom silicon - in this work we present a method to map DLGNs in a one-to-one fashion to a digital CMOS standard cell library by converting the trained model to a gate-level netlist. We also propose a novel loss function whereby the DLGN can optimize the area, and indirectly power consumption, of the resulting circuit by minimizing the expected area per neuron based on the area of the standard cells in the target standard cell library. Finally, we also show for the first time an implementation of a DLGN as a silicon circuit in simulation, performing layout of a DLGN in the SkyWater 130nm process as a custom hard macro using a Cadence standard cell library and performing post-layout power analysis. We find that our custom macro can perform classification on MNIST with 97% accuracy 41.8 million times a second at a power consumption of 83.88 mW.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。