通过时空注意力机制提升脉冲神经网络性能,实现高效精准的模式识别。
STAA-SNN: Spatial-Temporal Attention Aggregator for Spiking Neural Networks
- 设计脉冲驱动的时空注意力机制,动态捕捉空间与时间依赖关系。
- 在CIFAR-10、CIFAR-100和ImageNet上分别达到97.14%、82.05%、70.40%准确率。
- 仅用更少时间步即实现0.33%~2.80%性能提升,适合低功耗场景应用。
脉冲神经网络(SNNs)因其生物合理性与能效优势备受关注,但其性能仍显著落后于人工神经网络(ANNs)。本文提出时空注意力聚合框架STAA-SNN,通过脉冲驱动的自注意力机制动态捕捉空间与时间依赖。首次引入位置编码以建模潜在时序关系,并采用步骤注意力选择性增强不同时步特征。此外,通过时间步随机丢弃策略避免局部最优。实验表明,该框架在多个数据集上表现优异,尤其在神经形态数据集CIFAR10-DVS上达到领先水平;在静态数据集上,模型在较少时间步下实现0.33%至2.80%的性能提升,具备良好泛化能力。代码已开源。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) have gained significant attention due to their biological plausibility and energy efficiency, making them promising alternatives to Artificial Neural Networks (ANNs). However, the performance gap between SNNs and ANNs remains a substantial challenge hindering the widespread adoption of SNNs. In this paper, we propose a Spatial-Temporal Attention Aggregator SNN (STAA-SNN) framework, which dynamically focuses on and captures both spatial and temporal dependencies. First, we introduce a spike-driven self-attention mechanism specifically designed for SNNs. Additionally, we pioneeringly incorporate position encoding to integrate latent temporal relationships into the incoming features. For spatial-temporal information aggregation, we employ step attention to selectively amplify relevant features at different steps. Finally, we implement a time-step random dropout strategy to avoid local optima. As a result, STAA-SNN effectively captures both spatial and temporal dependencies, enabling the model to analyze complex patterns and make accurate predictions. The framework demonstrates exceptional performance across diverse datasets and exhibits strong generalization capabilities. Notably, STAA-SNN achieves state-of-the-art results on neuromorphic datasets CIFAR10-DVS, with remarkable performances of 97.14%, 82.05% and 70.40% on the static datasets CIFAR-10, CIFAR-100 and ImageNet, respectively. Furthermore, our model exhibits improved performance ranging from 0.33\% to 2.80\% with fewer time steps. The code for the model is available on GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。