为每张样本定制噪声,提升对抗后门攻击的认证防御效果
Cert-SSBD: Certified Backdoor Defense with Sample-Specific Smoothing Noises
- 针对不同样本优化噪声强度,实现个性化防护
- 在多个数据集上实现更高认证准确率,优于现有方法
- 适合关注模型安全性的研究人员和工业应用开发者
深度神经网络易受后门攻击,攻击者通过篡改少量训练数据,在模型中植入隐蔽后门。正常样本下模型表现正常,但对含后门的样本会误判至攻击者指定类别,威胁真实场景应用。现有经验性防御常被高级后门技术绕过。相比之下,基于随机平滑的认证防御通过向训练和测试样本添加随机噪声来抵御攻击。本文指出,现有方法隐含假设所有样本到决策边界的距离相同,这在实践中不成立,导致认证性能下降。为此,我们提出样本特定的认证防御方法 Cert-SSB:首先使用随机梯度上升为每个样本优化噪声幅度,再在多个污染训练集上重新训练多个平滑模型;随后聚合多个平滑模型的预测结果生成最终鲁棒输出。由于噪声随样本变化,传统认证方法失效。为此,我们引入基于存储-更新的认证机制,动态调整每个样本的认证区域以提升性能。我们在多个基准数据集上进行了大量实验,验证了所提方法的有效性。代码已公开于 https://github.com/NcepuQiaoTing/Cert-SSB。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) are vulnerable to backdoor attacks, where an attacker manipulates a small portion of the training data to implant hidden backdoors into the model. The compromised model behaves normally on clean samples but misclassifies backdoored samples into the attacker-specified target class, posing a significant threat to real-world DNN applications. Currently, several empirical defense methods have been proposed to mitigate backdoor attacks, but they are often bypassed by more advanced backdoor techniques. In contrast, certified defenses based on randomized smoothing have shown promise by adding random noise to training and testing samples to counteract backdoor attacks. In this paper, we reveal that existing randomized smoothing defenses implicitly assume that all samples are equidistant from the decision boundary. However, it may not hold in practice, leading to suboptimal certification performance. To address this issue, we propose a sample-specific certified backdoor defense method, termed Cert-SSB. Cert-SSB first employs stochastic gradient ascent to optimize the noise magnitude for each sample, ensuring a sample-specific noise level that is then applied to multiple poisoned training sets to retrain several smoothed models. After that, Cert-SSB aggregates the predictions of multiple smoothed models to generate the final robust prediction. In particular, in this case, existing certification methods become inapplicable since the optimized noise varies across different samples. To conquer this challenge, we introduce a storage-update-based certification method, which dynamically adjusts each sample's certification region to improve certification performance. We conduct extensive experiments on multiple benchmark datasets, demonstrating the effectiveness of our proposed method. Our code is available at https://github.com/NcepuQiaoTing/Cert-SSB.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。