提出频域时空注意力模块,提升脉冲神经网络特征学习效率
FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks
- 基于时空分析设计频域注意力机制,抑制冗余脉冲
- 降低脉冲发放率,多个数据集上优于当前最佳模型
- 适合追求能效比的脉冲神经网络研究与应用
脉冲神经网络(SNNs)因其固有的能效优势正成为人工神经网络的有力替代。由于SNN中脉冲生成具有内在稀疏性,中间输出脉冲的深入分析与优化常被忽略,这严重限制了其能效潜力,并削弱了在时空特征提取中的优势,导致精度不足且能耗浪费。本文从时空两个维度分析SNN的脉冲特性:空间上,浅层侧重垂直方向变化,深层逐渐学习水平变化;时间上,不同时间步间特征学习差异不大,增加时间步对特征学习帮助有限。基于上述发现,提出频域时空注意力(FSTA)模块,通过抑制冗余脉冲特征来增强特征学习能力。实验表明,引入FSTA模块显著降低了SNN的脉冲发放率,在多个数据集上性能优于现有先进基线。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) are emerging as a promising alternative to Artificial Neural Networks (ANNs) due to their inherent energy efficiency. Owing to the inherent sparsity in spike generation within SNNs, the in-depth analysis and optimization of intermediate output spikes are often neglected. This oversight significantly restricts the inherent energy efficiency of SNNs and diminishes their advantages in spatiotemporal feature extraction, resulting in a lack of accuracy and unnecessary energy expenditure. In this work, we analyze the inherent spiking characteristics of SNNs from both temporal and spatial perspectives. In terms of spatial analysis, we find that shallow layers tend to focus on learning vertical variations, while deeper layers gradually learn horizontal variations of features. Regarding temporal analysis, we observe that there is not a significant difference in feature learning across different time steps. This suggests that increasing the time steps has limited effect on feature learning. Based on the insights derived from these analyses, we propose a Frequency-based Spatial-Temporal Attention (FSTA) module to enhance feature learning in SNNs. This module aims to improve the feature learning capabilities by suppressing redundant spike features.The experimental results indicate that the introduction of the FSTA module significantly reduces the spike firing rate of SNNs, demonstrating superior performance compared to state-of-the-art baselines across multiple datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。