通过调控膜电位分布提升脉冲神经网络抗攻击能力
MPD-SGR: Robust Spiking Neural Networks with Membrane Potential Distribution-Driven Surrogate Gradient Regularization
- 基于膜电位分布与梯度函数的交互设计正则化方法
- 在多个数据集上显著增强脉冲网络对对抗攻击的抵抗力
- 适用于多种网络结构和编码方式,通用性强
脉冲梯度(SG)方法虽能提升深度脉冲神经网络(SNNs)性能,但使其易受对抗攻击。尽管脉冲编码策略和神经动力学参数已被广泛研究,但反映模型对输入扰动敏感性的梯度幅度这一关键因素仍被忽视。在SNN中,梯度幅度主要由膜电位分布(MPD)与SG函数的交互决定。本文理论分析表明,降低处于SG函数可导区间的膜电位比例,能有效减弱SNN对输入扰动的敏感性。据此提出一种新的MPD驱动的脉冲梯度正则化方法(MPD-SGR),通过显式调控MPD以增强鲁棒性。在多个图像分类基准及不同网络架构上的实验表明,MPD-SGR显著提升SNN对对抗扰动的抵抗能力,且在不同网络配置、SG函数和脉冲编码方案下均表现出强泛化性。
原文摘要 · Abstract (English)
The surrogate gradient (SG) method has shown significant promise in enhancing the performance of deep spiking neural networks (SNNs), but it also introduces vulnerabilities to adversarial attacks. Although spike coding strategies and neural dynamics parameters have been extensively studied for their impact on robustness, the critical role of gradient magnitude, which reflects the model's sensitivity to input perturbations, remains underexplored. In SNNs, the gradient magnitude is primarily determined by the interaction between the membrane potential distribution (MPD) and the SG function. In this study, we investigate the relationship between the MPD and SG and their implications for improving the robustness of SNNs. Our theoretical analysis reveals that reducing the proportion of membrane potentials lying within the gradient-available range of the SG function effectively mitigates the sensitivity of SNNs to input perturbations. Building upon this insight, we propose a novel MPD-driven surrogate gradient regularization (MPD-SGR) method, which enhances robustness by explicitly regularizing the MPD based on its interaction with the SG function. Extensive experiments across multiple image classification benchmarks and diverse network architectures confirm that the MPD-SGR method significantly enhances the resilience of SNNs to adversarial perturbations and exhibits strong generalizability across diverse network configurations, SG functions, and spike encoding schemes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。