提出误差补偿学习框架,实现高效低功耗的ANN到SNN转换
Efficient ANN-SNN Conversion with Error Compensation Learning
- 引入可学习阈值裁剪与双阈值神经元,动态优化转换过程
- 仅用2个时间步即达94.75%准确率,推理延迟显著降低
- 适合低功耗硬件部署,推动SNN在实时系统中的应用
人工神经网络(ANN)在众多任务中表现优异,但因高计算与内存需求,在资源受限环境部署困难。脉冲神经网络(SNN)通过离散脉冲事件运行,具备更高能效,是生物启发式替代方案。然而,现有ANN到SNN的转换常导致显著精度下降和推理时间增加,主要源于裁剪、量化及激活不均等转换误差。本文提出基于误差补偿学习的新型转换框架,引入可学习阈值裁剪函数、双阈值神经元及优化膜电位初始化策略,分别自适应缓解裁剪误差、动态降低量化误差、有效抑制非均匀性误差。在CIFAR-10、CIFAR-100、ImageNet数据集上的实验表明,本方法在现有转换技术中实现高精度与超低延迟。使用仅两个时间步,该方法在ResNet-18结构下于CIFAR-10上保持94.75%的竞争力准确率,显著缩短推理时间。研究推动了SNN在低功耗硬件上的实际应用,实现高效实时处理。
原文摘要 · Abstract (English)
Artificial neural networks (ANNs) have demonstrated outstanding performance in numerous tasks, but deployment in resource-constrained environments remains a challenge due to their high computational and memory requirements. Spiking neural networks (SNNs) operate through discrete spike events and offer superior energy efficiency, providing a bio-inspired alternative. However, current ANN-to-SNN conversion often results in significant accuracy loss and increased inference time due to conversion errors such as clipping, quantization, and uneven activation. This paper proposes a novel ANN-to-SNN conversion framework based on error compensation learning. We introduce a learnable threshold clipping function, dual-threshold neurons, and an optimized membrane potential initialization strategy to mitigate the conversion error. Together, these techniques address the clipping error through adaptive thresholds, dynamically reduce the quantization error through dual-threshold neurons, and minimize the non-uniformity error by effectively managing the membrane potential. Experimental results on CIFAR-10, CIFAR-100, ImageNet datasets show that our method achieves high-precision and ultra-low latency among existing conversion methods. Using only two time steps, our method significantly reduces the inference time while maintains competitive accuracy of 94.75% on CIFAR-10 dataset under ResNet-18 structure. This research promotes the practical application of SNNs on low-power hardware, making efficient real-time processing possible.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。