arXiv:2411.02854cs.ARcs.LG2024-11被引 3

可重构数字存内计算神经芯片,高效处理事件视觉数据。

SpiDR: A Reconfigurable Digital Compute-in-Memory Spiking Neural Network Accelerator for Event-based Perception

  • 采用存内计算与可重构模式,减少数据搬运
  • 支持多精度权重与膜电位,能效比达5 TOPS/W
  • 零跳过机制利用脉冲稀疏性,适合低功耗场景

脉冲神经网络(SNN)凭借其固有的递归特性,能够高效处理动态视觉传感器(DVS)生成的异步时间数据,适用于事件驱动视觉任务。然而,现有SNN加速器存在对不同神经元模型、比特精度和网络规模适应性差,膜电位(Vmem)处理效率低,稀疏优化有限等问题。为此,我们提出一种可扩展、可重构的数字存内计算(CIM)SNN加速器 \ chipname,具备四大核心特性:1)通过存内计算与可重构工作模式,最小化权重与Vmem数据结构带来的数据移动,高效适配不同负载;2)支持多种权重/Vmem比特精度,实现精度与能效的平衡,提升对多样化应用需求的适应能力;3)采用零跳过机制,利用脉冲的固有稀疏性,在不引入高开销的前提下显著降低能耗,尤其适用于低稀疏度场景;4)异步握手机制保障了不同计算单元执行时间差异下的流水线效率。 chipname 在65 nm TSMC低功耗工艺下流片实现。在相同技术节点下,性能优于近期文献中提出的其他数字SNN加速器,具备先进可重构性。在95%输入稀疏度下,使用4比特权重与7比特膜电位精度时,能效高达5 TOPS/W。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs), with their inherent recurrence, offer an efficient method for processing the asynchronous temporal data generated by Dynamic Vision Sensors (DVS), making them well-suited for event-based vision applications. However, existing SNN accelerators suffer from limitations in adaptability to diverse neuron models, bit precisions and network sizes, inefficient membrane potential (Vmem) handling, and limited sparse optimizations. In response to these challenges, we propose a scalable and reconfigurable digital compute-in-memory (CIM) SNN accelerator \chipname with a set of key features: 1) It uses in-memory computations and reconfigurable operating modes to minimize data movement associated with weight and Vmem data structures while efficiently adapting to different workloads. 2) It supports multiple weight/Vmem bit precision values, enabling a trade-off between accuracy and energy efficiency and enhancing adaptability to diverse application demands. 3) A zero-skipping mechanism for sparse inputs significantly reduces energy usage by leveraging the inherent sparsity of spikes without introducing high overheads for low sparsity. 4) Finally, the asynchronous handshaking mechanism maintains the computational efficiency of the pipeline for variable execution times of different computation units. We fabricated \chipname in 65 nm Taiwan Semiconductor Manufacturing Company (TSMC) low-power (LP) technology. It demonstrates competitive performance (scaled to the same technology node) to other digital SNN accelerators proposed in the recent literature and supports advanced reconfigurability. It achieves up to 5 TOPS/W energy efficiency at 95% input sparsity with 4-bit weights and 7-bit Vmem precision.

神经网络加速存内计算事件视觉低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。