arXiv:2607.11914cs.NEcs.AI2026-07

提出新型脉冲网络,提升精度与抗干扰能力。

Burst Spiking Neural Networks

论文配图:Burst Spiking Neural Networks
图 1 · 摘自论文原文
  • 引入爆发式放电机制和动态权重约束
  • 在ImageNet上精度提升3.18%,抗噪能力提高2.66%
  • 保持低功耗优势,接近8比特人工神经网络表现

当前脉冲神经网络(SNN)研究的目标是提升其精度,以成为低功耗的人工神经网络(ANN)替代方案。本文指出,实现这一目标还需提升鲁棒性——即在输入扰动下仍能保持正确预测。现有方法存在两大问题:二值脉冲激活易受微小扰动影响导致状态剧烈变化;缺乏有效权重约束使输出对输入变化更敏感。为此,提出爆发式脉冲神经网络(BuSNN),基于爆发增强型脉冲神经元(BSNs)与动态权重约束(DWC)机制。BSNs通过爆发放电实现非二值化脉冲模式,缓解扰动引发的状态跃迁,提升鲁棒性;DWC根据激活状态惩罚连接权重,有效降低权重幅值,改善鲁棒性且不损失精度。理论分析支持上述效果。实验显示,在较小规模数据集如CIFAR-10上,BuSNN优于同类SNN与ANN;在大规模ImageNet上,采用MS ResNet-34骨干网络的BuSNN相比对应SNN基线,顶1精度提升3.18%,抗畸变鲁棒性提升2.66%。尽管使用脉冲激活,其性能超越4比特量化激活的ANN基线,接近8比特基线,同时保留了SNN的低功耗优势。该工作推动了SNN在高鲁棒性、低功耗场景下的实际应用。

原文摘要 · Abstract (English)

A central goal of current Spiking Neural Network (SNN) research is to improve their accuracy toward becoming low-power alternatives to Artificial Neural Networks (ANNs). This work further argues that realizing this ambition requires improving not only accuracy but also robustness, defined as the ability to maintain correct predictions under input perturbations. We identify two key issues in existing SNN methods that undermine robustness. First, binary spiking activations can produce large activation-state changes under small perturbations. Second, the lack of effective weight constraints makes network outputs more sensitive to input variations. To this end, we propose Burst Spiking Neural Networks (BuSNNs), built upon Burst-enhanced Spiking Neurons (BSNs) and a Dynamic Weight Constraint (DWC) mechanism. BSNs incorporate burst firing to provide a graded spiking pattern. This spiking mechanism mitigates perturbation-induced transitions in activation states and thereby enhances robustness. DWC penalizes connection weights based on activation states, effectively reducing weight magnitudes and improving robustness while preserving accuracy. We provide theoretical analyses to support these robustness effects. Experimental results further show that, on smaller-scale benchmarks such as CIFAR-10, BuSNNs outperform both SNN and ANN counterparts in accuracy and robustness. On large-scale ImageNet, BuSNN with the MS ResNet-34 backbone further improves top-1 accuracy and corruption robustness over the corresponding SNN baseline by 3.18% and 2.66%, respectively. Despite using spike-based activations, BuSNNs surpass 4-bit activation-quantized ANN baselines and approach 8-bit ANN baselines on ImageNet. They also preserve SNNs' low-power advantage. This work studies the accuracy-robustness problem in SNNs, advancing their practical viability in robust and energy-efficient applications.

脉冲神经网络鲁棒性低功耗图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。