通过改进模板设计,在小幅降低精度前提下显著减少神经网络算术单元面积。
An Improved Template for Approximate Computing
- 提出可参数化的乘法共享模板,替代原有简单乘积结构。
- 在相同精度损失下,面积节省比现有方法提升12%以上。
- 适合资源受限的边缘设备部署,尤其关注能效比的场景。
将神经网络部署于边缘设备需在推理能耗与分类准确率之间取得平衡。近似计算通过适度降低算术运算精度来减少能耗。本文提出一种新方法,通过改进布尔重写技术XPAT中的可参数化模板,降低神经网络中小型算术单元(加法器、乘法器)的面积。相较于传统方法,该模板以参数作为面积指标的近似代理,采用可参数化的乘法共享结构,在实验中展现出更优的收敛性,能在相同精度损失下实现更大面积节省。结果表明,本方法在面积优化上优于原始XPAT及另外两种先进方法。
原文摘要 · Abstract (English)
Deploying neural networks on edge devices entails a careful balance between the energy required for inference and the accuracy of the resulting classification. One technique for navigating this tradeoff is approximate computing: the process of reducing energy consumption by slightly reducing the accuracy of arithmetic operators. In this context, we propose a methodology to reduce the area of the small arithmetic operators used in neural networks - i.e., adders and multipliers - via a small loss in accuracy, and show that we improve area savings for the same accuracy loss w.r.t. the state of the art. To achieve our goal, we improve on a boolean rewriting technique recently proposed, called XPAT, where the use of a parametrisable template to rewrite circuits has proved to be highly beneficial. In particular, XPAT was able to produce smaller circuits than comparable approaches while utilising a naive sum of products template structure. In this work, we show that template parameters can act as proxies for chosen metrics and we propose a novel template based on parametrisable product sharing that acts as a close proxy to synthesised area. We demonstrate experimentally that our methodology converges better to low-area solutions and that it can find better approximations than both the original XPAT and two other state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。