通过引入‘无关项’压缩查表,显著减少神经网络硬件占用
ReducedLUT: Table Decomposition with "Don't Care" Conditions
- 在查表压缩中引入‘无关项’,增加可复用结构
- 实测查表资源使用减少1.63倍,精度损失小于0.01点
- 适合追求低功耗、小体积部署的AI芯片设计者
查找表(LUT)常用于高效存储复杂数学运算的预计算值。在神经网络中,这些函数缺乏明显模式,传统逻辑综合技术难以有效处理。现有方法如直接查表、分段线性近似和多部分表法,在处理基于LUT的神经网络时往往导致硬件效率低下。本文提出ReducedLUT,通过在压缩过程中注入‘无关项’(don't cares),增加自相似性,从而更有效地利用已有分解技术。特别地,我们通过将神经网络训练数据中的未观测模式替换为‘无关项’,实现更大压缩比,同时保持模型精度几乎不变。实验表明,该方法可实现最高1.63倍的物理LUT资源节省,测试精度下降不超过0.01个百分点。
原文摘要 · Abstract (English)
Lookup tables (LUTs) are frequently used to efficiently store arrays of precomputed values for complex mathematical computations. When used in the context of neural networks, these functions exhibit a lack of recognizable patterns which presents an unusual challenge for conventional logic synthesis techniques. Several approaches are known to break down a single large lookup table into multiple smaller ones that can be recombined. Traditional methods, such as plain tabulation, piecewise linear approximation, and multipartite table methods, often yield inefficient hardware solutions when applied to LUT-based NNs. This paper introduces ReducedLUT, a novel method to reduce the footprint of the LUTs by injecting don't cares into the compression process. This additional freedom introduces more self-similarities which can be exploited using known decomposition techniques. We then demonstrate a particular application to machine learning; by replacing unobserved patterns within the training data of neural network models with don't cares, we enable greater compression with minimal model accuracy degradation. In practice, we achieve up to $1.63\times$ reduction in Physical LUT utilization, with a test accuracy drop of no more than $0.01$ accuracy points.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。