提出新方法提升脉冲神经网络抗攻击评估可靠性
Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks
- 设计自适应尖锐度代理梯度,缓解梯度消失问题
- 新攻击方法在不精确梯度下收敛更快更稳定
- 发现现有SNN鲁棒性被严重高估,需改进训练
脉冲神经网络(SNNs)通过脉冲激活模拟大脑的节能信息处理,但其二值化和不连续的特性导致梯度消失,使基于梯度下降的对抗鲁棒性评估不可靠。尽管已有改进的代理梯度方法,但在强对抗攻击下的有效性仍不明确。本文提出更可靠的SNN对抗鲁棒性评估框架:理论上分析代理梯度中的梯度消失程度,引入自适应尖锐度代理梯度(ASSG),在攻击迭代中根据输入分布动态调整代理函数形状,提升梯度准确性并缓解梯度消失。此外,设计了带自适应步长的$L_\infty$约束攻击方法——稳定自适应投影梯度下降(SA-PGD),在梯度不准确时实现更快更稳定的收敛。大量实验表明,该方法显著提升了不同对抗训练方案、SNN架构和神经元模型下的攻击成功率,提供了更通用可靠的评估。实验结果还揭示当前SNN的鲁棒性被显著高估,凸显需要更可靠的对抗训练方法。代码已开源:https://github.com/craree/ASSG-SNNs-Robustness-Evaluation。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) utilize spike-based activations to mimic the brain's energy-efficient information processing. However, the binary and discontinuous nature of spike activations causes vanishing gradients, making adversarial robustness evaluation via gradient descent unreliable. While improved surrogate gradient methods have been proposed, their effectiveness under strong adversarial attacks remains unclear. We propose a more reliable framework for evaluating SNN adversarial robustness. We theoretically analyze the degree of gradient vanishing in surrogate gradients and introduce the Adaptive Sharpness Surrogate Gradient (ASSG), which adaptively evolves the shape of the surrogate function according to the input distribution during attack iterations, thereby enhancing gradient accuracy while mitigating gradient vanishing. In addition, we design an adversarial attack with adaptive step size under the $L_\infty$ constraint-Stable Adaptive Projected Gradient Descent (SA-PGD), achieving faster and more stable convergence under imprecise gradients. Extensive experiments show that our approach substantially increases attack success rates across diverse adversarial training schemes, SNN architectures and neuron models, providing a more generalized and reliable evaluation of SNN adversarial robustness. The experimental results further reveal that the robustness of current SNNs has been significantly overestimated and highlighting the need for more dependable adversarial training methods. The code is released at https://github.com/craree/ASSG-SNNs-Robustness-Evaluation
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。