用二叉树结构实现低功耗高精度的随机数生成,助力边缘设备高效运行概率神经网络。
TreeGRNG: Binary Tree Gaussian Random Number Generator for Efficient Probabilistic AI Hardware

- 采用二叉树结构与固定比较器,替代复杂运算,降低硬件成本。
- 能耗降低3.7倍,单位面积吞吐量提升5.8倍,分布精度优于现有方案。
- 可灵活调整分布形状,适合未来边缘端概率性AI系统设计。
贝叶斯神经网络(BNNs)通过量化决策不确定性,显著提升传统神经网络的可信度。然而,在极端边缘设备上进行BNN推理时,每个神经元需集成高斯随机数生成器(GRNG),而现有主流GRNG算法依赖大量算术运算和庞大查表,给超低功耗硬件实现带来巨大挑战。为此,本文提出一种创新的二叉树随机数生成器(TreeGRNG),仅使用低成本恒定比较器,无需复杂算术单元。进一步结合面向硬件的优化策略,利用高斯分布特性提升性能。优化后的TreeGRNG在分布精度上超越当前最先进(SoTA)水平,同时实现每样本能耗降低3.7倍,单位面积吞吐量提升5.8倍。此外,该方案在灵活性方面具有显著优势,支持设计者便捷调节采样分布形状,突破传统GRNG局限,为未来概率性AI硬件设计开辟新路径。相关代码已开源。
原文摘要 · Abstract (English)
Bayesian Neural Networks (BNNs) offer opportunities for greatly enhancing the trustworthiness of conventional neural networks by monitoring the uncertainties in decision-making. A significant drawback for BNN inference at the extreme edge, however, is the imperative need to incorporate Gaussian Random Number Generators (GRNG) within each neuron. State-of-the-art GRNG algorithms heavily depend on multiple arithmetic operations and the use of extensive look-up tables, posing significant implementation challenges for ultra-low power hardware implementations. To overcome this, this paper presents an innovative binary tree random number generator (TreeGRNG) allowing the use of ultra-low-cost constant comparators instead of arithmetic units. We further enhance the TreeGRNG proposal with a set of hardware-aware optimizations exploiting the Gaussian properties. The optimized TreeGRNG surpasses the State-of-the-Art (SoTA) in terms of distribution accuracy while achieving a 3.7$\times$ reduction in energy per sample and boosting the throughput per unit area by 5.8$\times$. Moreover, our TreeGRNG proposal possesses a distinct advantage over the current SoTA in terms of flexibility, as it easily enables designers to adjust the shape of the sampled probability distribution, extending beyond the capabilities of traditional GRNGs, opening the horizon towards future probabilistic AI designs. The TreeGRNG design is available open-source in the link
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。