SpikeFit让脉冲网络在神经形态硬件上高效部署,兼顾算力与能效。
SpikeFit: Towards Optimal Deployment of Spiking Networks on Neuromorphic Hardware
- 将离散权重值作为可学习参数,联合优化模型与硬件约束
- 4种权重值下性能超越现有压缩方法,能效最低
- 适配多种神经形态芯片,支持低精度高压缩部署
本文提出SpikeFit,一种针对脉冲神经网络(SNN)的新训练方法,可实现神经形态硬件上的高效推理,充分考虑设备的严格限制:单芯片可容纳的神经元与突触数量,以及低比特表示(如4位、8位)。与仅解决部分问题(如数值精度或神经元数量限制)的传统压缩方法不同,SpikeFit将允许的权重离散值本身作为可学习参数,与模型联合优化,实现低精度(2、4或8位)下的最优聚类感知训练(CAT),显著提升网络压缩效率,并将唯一突触连接数控制在神经形态处理器所需范围内。该联合优化使SpikeFit找到与硬件约束对齐的离散权重集,支持更广泛神经形态处理器的完整部署。此外,SpikeFit引入新型硬件友好的Fisher Spike贡献(FSC)剪枝方法,表现达到当前最优。实验表明,在仅允许4种独特突触权重值(M=4)的条件下,SpikeFit不仅优于现有SNN压缩方法和传统极端量化结合聚类的基线,且满足更广范围的硬件需求,实测能耗最低。
原文摘要 · Abstract (English)
This paper introduces SpikeFit, a novel training method for Spiking Neural Networks (SNNs) that enables efficient inference on neuromorphic hardware, considering all its stringent requirements: the number of neurons and synapses that can fit on a single device, and lower bit-width representations (e.g., 4-bit, 8-bit). Unlike conventional compressing approaches that address only a subset of these requirements (limited numerical precision and limited number of neurons in the network), SpikeFit treats the allowed weights' discrete values themselves as learnable parameters co-optimized with the model, allowing for optimal Clusterization-Aware Training (CAT) of the model's weights at low precision (2-, 4-, or 8-bit) which results in higher network compression efficiency, as well as limiting the number of unique synaptic connections to a value required by neuromorphic processor. This joint optimization allows SpikeFit to find a discrete weight set aligned with hardware constraints, enabling the most complete deployment across a broader range of neuromorphic processors than existing methods of SNN compression support. Moreover, SpikeFit introduces a new hardware-friendly Fisher Spike Contribution (FSC) pruning method showing the state-of-the-art performance. We demonstrate that for spiking neural networks constrained to only four unique synaptic weight values (M = 4), our SpikeFit method not only outperforms state-of-the-art SNNs compression methods and conventional baselines combining extreme quantization schemes and clustering algorithms, but also meets a wider range of neuromorphic hardware requirements and provides the lowest energy use in experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。