首次评估脉冲神经网络的成员隐私,发现其对成员推断攻击更脆弱。
Membership Privacy Evaluation in Deep Spiking Neural Networks
- 对比8种成员推断攻击,7种源自传统神经网络
- 在脉冲数据上,攻击准确率最高比传统网络高10%
- 数据增强可降低攻击性能,最多减少25.7%
人工神经网络(ANN)通常以非线性函数模拟神经元,对数据点在前向传播中输出浮点数信号。而脉冲神经网络(SNN)在前向传播中接收多样输入信号,以生物合理方式模拟神经元:当膜电位累积超过阈值时产生脉冲(二值信号)。尽管ANN在人脸识别、目标检测等任务中取得显著成果,但近年来由于低功耗、快速推理和事件驱动特性,SNN受到关注。然而,针对ANN的隐私威胁研究广泛,对SNN的研究却较少。例如,已知ANN易受成员推断攻击(MIA),但其在SNN中的适用性尚未被探索。本文评估了基于八种MIA的SNN成员隐私,其中七种受传统ANN攻击启发。结果表明,当两者均在含时间维度的脉冲数据集上训练时,SNN比ANN更易受攻击(最大平衡攻击准确率高10%)。而在静态数据集(无时间维度)上训练时,脆弱性取决于数据集。若将静态数据上训练的ANN转换为SNN,MIA准确率下降(最大降低11.5%,目标模型测试准确率下降7.6%)。此外,通过超参数分析探究了影响因素,并证明基础数据增强方法及两种最新脉冲数据增强方法可显著降低攻击效果(最大降低25.7%)。
原文摘要 · Abstract (English)
Artificial Neural Networks (ANNs), commonly mimicking neurons with non-linear functions to output floating-point numbers, consistently receive the same signals of a data point during its forward time. Unlike ANNs, Spiking Neural Networks (SNNs) get various input signals in the forward time of a data point and simulate neurons in a biologically plausible way, i.e., producing a spike (a binary value) if the accumulated membrane potential of a neuron is larger than a threshold. Even though ANNs have achieved remarkable success in multiple tasks, e.g., face recognition and object detection, SNNs have recently obtained attention due to their low power consumption, fast inference, and event-driven properties. While privacy threats against ANNs are widely explored, much less work has been done on SNNs. For instance, it is well-known that ANNs are vulnerable to the Membership Inference Attack (MIA), but whether the same applies to SNNs is not explored. In this paper, we evaluate the membership privacy of SNNs by considering eight MIAs, seven of which are inspired by MIAs against ANNs. Our evaluation results show that SNNs are more vulnerable (maximum 10% higher in terms of balanced attack accuracy) than ANNs when both are trained with neuromorphic datasets (with time dimension). On the other hand, when training ANNs or SNNs with static datasets (without time dimension), the vulnerability depends on the dataset used. If we convert ANNs trained with static datasets to SNNs, the accuracy of MIAs drops (maximum 11.5% with a reduction of 7.6% on the test accuracy of the target model). Next, we explore the impact factors of MIAs on SNNs by conducting a hyperparameter study. Finally, we show that the basic data augmentation method for static data and two recent data augmentation methods for neuromorphic data can considerably (maximum reduction of 25.7%) decrease MIAs' performance on SNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。