arXiv:2504.06748cs.LG2025-04被引 9

在SpiNNaker2上实现高效脉冲神经网络部署,用于动态视觉传感器手势识别。

Efficient Deployment of Spiking Neural Networks on SpiNNaker2 for DVS Gesture Recognition Using Neuromorphic Intermediate Representation

  • 提出两种8位定点量化方法,结合阈值自适应与百分位缩放。
  • 在SpiNNaker2芯片上实现94.13%准确率,接近32位浮点性能。
  • 首次基于神经形态中间表示(NIR)在该硬件上完成完整推理部署。

脉冲神经网络(SNNs)在推理阶段具有高能效,特别适合部署在神经形态硬件上。其处理动态视觉传感器(DVS)等事件驱动输入的能力,进一步提升了其在边缘计算任务中的适用性。然而,边缘硬件的资源限制要求采用如权重量化等技术,以降低内存占用同时保持精度。现有量化方法多聚焦于突触权重,忽视了神经元放电阈值等关键参数。为此,我们首次针对DVS手势识别任务,在多核神经形态芯片SpiNNaker2上构建了基准测试。评估了两种定点计算的量化方案:第一种为基于百分位阈值缩放的训练后量化(PTQ),第二种为结合自适应阈值缩放的量化感知训练(QAT)。两种方法均实现8位芯片内推理,准确率接近32位浮点性能。此外,基线SNN模型在无需特殊技术情况下,表现已优于已有结果。所有模型通过神经形态中间表示(NIR)部署于SpiNNaker2,最终实现94.13%的芯片内分类准确率,验证了SpiNNaker2在高效低功耗神经形态计算中的潜力。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs) are highly energy-efficient during inference, making them particularly suitable for deployment on neuromorphic hardware. Their ability to process event-driven inputs, such as data from dynamic vision sensors (DVS), further enhances their applicability to edge computing tasks. However, the resource constraints of edge hardware necessitate techniques like weight quantization, which reduce the memory footprint of SNNs while preserving accuracy. Despite its importance, existing quantization methods typically focus on synaptic weights quantization without taking account of other critical parameters, such as scaling neuron firing thresholds. To address this limitation, we present the first benchmark for the DVS gesture recognition task using SNNs optimized for the many-core neuromorphic chip SpiNNaker2. Our study evaluates two quantization pipelines for fixed-point computations. The first approach employs post training quantization (PTQ) with percentile-based threshold scaling, while the second uses quantization aware training (QAT) with adaptive threshold scaling. Both methods achieve accurate 8-bit on-chip inference, closely approximating 32-bit floating-point performance. Additionally, our baseline SNNs perform competitively against previously reported results without specialized techniques. These models are deployed on SpiNNaker2 using the neuromorphic intermediate representation (NIR). Ultimately, we achieve 94.13% classification accuracy on-chip, demonstrating the SpiNNaker2's potential for efficient, low-energy neuromorphic computing.

脉冲神经网络神经形态计算边缘推理量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。