发现现有防御方法防不住后门重激活,提出新方法提升模型长期安全性。
Uncovering, Explaining, and Mitigating the Superficial Safety of Backdoor Defense
- 通过查询攻击验证净化后模型仍可快速重学后门行为。
- 仅用少量污染样本即可重新激活后门,说明防御不彻底。
- 提出路径感知最小化方法,显著提升净化后模型的鲁棒性。
后门攻击威胁深度神经网络,现有净化方法虽能降低攻击成功率(ASR),但未能真正消除预训练阶段学到的后门特征。本文深入研究净化后的鲁棒性,发现当前方法对后门行为的重学习极为敏感,即使使用极少量中毒样本微调,也能迅速恢复后门功能。为此,我们提出查询式重激活攻击(QRA),仅通过查询即可有效触发后门。其根本原因在于净化模型未充分偏离后门连通路径。为此,我们提出路径感知最小化(PAM)防御策略,通过额外模型更新增强沿后门路径的偏离度。大量实验表明,PAM在保持高干净准确率和低ASR的同时,显著提升了净化后的鲁棒性,为评估模型安全提供了新视角。
原文摘要 · Abstract (English)
Backdoor attacks pose a significant threat to Deep Neural Networks (DNNs) as they allow attackers to manipulate model predictions with backdoor triggers. To address these security vulnerabilities, various backdoor purification methods have been proposed to purify compromised models. Typically, these purified models exhibit low Attack Success Rates (ASR), rendering them resistant to backdoored inputs. However, Does achieving a low ASR through current safety purification methods truly eliminate learned backdoor features from the pretraining phase? In this paper, we provide an affirmative answer to this question by thoroughly investigating the Post-Purification Robustness of current backdoor purification methods. We find that current safety purification methods are vulnerable to the rapid re-learning of backdoor behavior, even when further fine-tuning of purified models is performed using a very small number of poisoned samples. Based on this, we further propose the practical Query-based Reactivation Attack (QRA) which could effectively reactivate the backdoor by merely querying purified models. We find the failure to achieve satisfactory post-purification robustness stems from the insufficient deviation of purified models from the backdoored model along the backdoor-connected path. To improve the post-purification robustness, we propose a straightforward tuning defense, Path-Aware Minimization (PAM), which promotes deviation along backdoor-connected paths with extra model updates. Extensive experiments demonstrate that PAM significantly improves post-purification robustness while maintaining a good clean accuracy and low ASR. Our work provides a new perspective on understanding the effectiveness of backdoor safety tuning and highlights the importance of faithfully assessing the model's safety.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。