提出自适应脉冲神经网络转换框架,显著提升能效与精度。
Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Network
- 设计自适应放电神经元模型,动态调节各层放电模式。
- 在三类数据集上实现最高70.1%的能耗降低,精度领先。
- 无需训练,适用于图像分类、检测与分割等多种任务。
脉冲神经网络(SNN)被视为传统人工神经网络(ANN)的节能替代方案,但性能差距仍是挑战。尽管通过从ANN到SNN的转换使差距逐渐缩小,仍需大量计算资源,且转换后的SNN能效难以保证。为此,我们提出一种统一的免训练转换框架,显著提升转换后SNN的性能与效率。受生物神经系统启发,提出新型自适应放电神经元模型(AdaFire),通过动态调整不同层的放电模式,大幅降低有限推理步数下的不均衡误差——这是转换后SNN的主要误差来源。进一步引入两种效率优化技术:敏感性脉冲压缩(SSC)减少脉冲操作,输入感知自适应步长(IAT)降低延迟。实验表明,该方法在CIFAR-10、CIFAR-100和ImageNet上分别实现最高70.1%、60.3%和43.1%的能耗节省,达到当前最优性能。在2D、3D、事件驱动分类、目标检测与分割任务中均表现优异。代码已开源:https://github.com/bic-L/burst-ann2snn。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) are seen as an energy-efficient alternative to traditional Artificial Neural Networks (ANNs), but the performance gap remains a challenge. While this gap is narrowing through ANN-to-SNN conversion, substantial computational resources are still needed, and the energy efficiency of converted SNNs cannot be ensured. To address this, we present a unified training-free conversion framework that significantly enhances both the performance and efficiency of converted SNNs. Inspired by the biological nervous system, we propose a novel Adaptive-Firing Neuron Model (AdaFire), which dynamically adjusts firing patterns across different layers to substantially reduce the Unevenness Error - the primary source of error of converted SNNs within limited inference timesteps. We further introduce two efficiency-enhancing techniques: the Sensitivity Spike Compression (SSC) technique for reducing spike operations, and the Input-aware Adaptive Timesteps (IAT) technique for decreasing latency. These methods collectively enable our approach to achieve state-of-the-art performance while delivering significant energy savings of up to 70.1%, 60.3%, and 43.1% on CIFAR-10, CIFAR-100, and ImageNet datasets, respectively. Extensive experiments across 2D, 3D, event-driven classification tasks, object detection, and segmentation tasks, demonstrate the effectiveness of our method in various domains. The code is available at: https://github.com/bic-L/burst-ann2snn.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。