arXiv:2412.13610cs.NEcs.AI2024-12ICML被引 4

提出并行脉冲计算与转换训练结合的新框架,显著提升SNN推理速度和性能。

Faster and Stronger: When ANN-SNN Conversion Meets Parallel Spiking Calculation

  • 建立时间步与脉冲频率的数学映射,实现无损转换
  • 在超低延迟下保持多种激活函数的高精度转换
  • 适合追求高效能、低延迟的SNN部署场景

脉冲神经网络(SNN)作为类脑且节能的模型,当前面临学习框架效率不足的关键挑战。主流训练方法如时空反向传播(STBP)和人工神经网络到脉冲神经网络(ANN-SNN)转换,分别存在训练开销大或推理延迟高的问题,限制了SNN向大规模网络和复杂应用的扩展。本文提出一种新型并行转换学习框架,建立了并行脉冲神经元各时间步与累积脉冲频率之间的数学映射关系。理论证明该转换过程具有无损性和排序保持性,并指出了每一步的最优偏移距离。进一步结合分布感知误差校准技术,可实现对更通用激活函数或免训练场景的高效转换。大量实验验证了该方法在多种转换情况下均具备显著性能优势,且具备超低推理延迟。据我们所知,这是首个将并行脉冲计算与ANN-SNN转换联合使用的方案,为SNN监督训练提供了极具前景的新路径。代码已开源:https://github.com/hzc1208/Parallel_Conversion。

原文摘要 · Abstract (English)

Spiking Neural Network (SNN), as a brain-inspired and energy-efficient network, is currently facing the pivotal challenge of exploring a suitable and efficient learning framework. The predominant training methodologies, namely Spatial-Temporal Back-propagation (STBP) and ANN-SNN Conversion, are encumbered by substantial training overhead or pronounced inference latency, which impedes the advancement of SNNs in scaling to larger networks and navigating intricate application domains. In this work, we propose a novel parallel conversion learning framework, which establishes a mathematical mapping relationship between each time-step of the parallel spiking neurons and the cumulative spike firing rate. We theoretically validate the lossless and sorting properties of the conversion process, as well as pointing out the optimal shifting distance for each step. Furthermore, by integrating the above framework with the distribution-aware error calibration technique, we can achieve efficient conversion towards more general activation functions or training-free circumstance. Extensive experiments have confirmed the significant performance advantages of our method for various conversion cases under ultra-low time latency. To our best knowledge, this is the first work which jointly utilizes parallel spiking calculation and ANN-SNN Conversion, providing a highly promising approach for SNN supervised training. Code is available at https://github.com/hzc1208/Parallel_Conversion.

SNN脉冲计算转换训练低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。