提出动态阈值的突触延迟模型,提升低延迟脉冲神经网络稳定性。
Optimization of Low-Latency Spiking Neural Networks Utilizing Historical Dynamics of Refractory Periods
- 基于膜电位变化历史动态调整突触延迟时间
- 减少冗余放电,静默数据集上准确率达98.6%
- 适合对噪声敏感的实时神经计算场景
突触延迟控制神经元放电频率,对网络稳定性和抗噪能力至关重要。随着脉冲神经网络(SNN)训练方法的发展,低延迟SNN应用日益广泛。在低延迟SNN中,短仿真步长使依赖经验分布或放电率的传统延迟机制失效。若忽略延迟,则易导致神经元过激活,降低系统鲁棒性。为此,我们提出历史动态突触延迟(HDRP)模型,利用膜电位导数与历史延迟信息估计初始延迟,并动态调节其时长;同时引入阈值依赖的延迟核以缓解神经元状态过度累积。该方法在保持SNN二值特性的同时,显著提升抗噪能力与整体性能。实验表明,HDRP-SNN相比传统SNN显著减少冗余放电,在静态数据集和类脑数据集上均达到当前最优(SOTA)准确率,且优于人工神经网络(ANNs)和传统SNN,在噪声环境下表现更优,验证了HDRP机制对低延迟SNN性能的关键作用。
原文摘要 · Abstract (English)
The refractory period controls neuron spike firing rate, crucial for network stability and noise resistance. With advancements in spiking neural network (SNN) training methods, low-latency SNN applications have expanded. In low-latency SNNs, shorter simulation steps render traditional refractory mechanisms, which rely on empirical distributions or spike firing rates, less effective. However, omitting the refractory period amplifies the risk of neuron over-activation and reduces the system's robustness to noise. To address this challenge, we propose a historical dynamic refractory period (HDRP) model that leverages membrane potential derivative with historical refractory periods to estimate an initial refractory period and dynamically adjust its duration. Additionally, we propose a threshold-dependent refractory kernel to mitigate excessive neuron state accumulation. Our approach retains the binary characteristics of SNNs while enhancing both noise resistance and overall performance. Experimental results show that HDRP-SNN significantly reduces redundant spikes compared to traditional SNNs, and achieves state-of-the-art (SOTA) accuracy both on static datasets and neuromorphic datasets. Moreover, HDRP-SNN outperforms artificial neural networks (ANNs) and traditional SNNs in noise resistance, highlighting the crucial role of the HDRP mechanism in enhancing the performance of low-latency SNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。