先暴露后防御:通过揭示隐藏后门提升模型安全性
Expose Before You Defend: Unifying and Enhancing Backdoor Defenses via Exposed Models
- 先用清洁遗忘等技术暴露后门特征,再检测清除
- 在10个图像攻击和6个文本攻击中均显著提升防御效果
- 适合研究后门防御或构建安全模型的开发者
后门攻击通过污染少量训练数据植入触发器,使深度神经网络在特定输入下产生错误输出。这一威胁在大规模预训练模型中尤为严重。本文提出一种名为Expose Before You Defend(EBYD)的两步防御框架,统一并增强了现有防御方法。首先通过「清洁遗忘」(CUL)等技术主动抹除干净特征,暴露隐藏的后门特征;随后对暴露后的模型进行检测与移除。我们在10个图像攻击和6个文本攻击上验证,覆盖CIFAR-10、ImageNet子集、SST-2、IMDB、Twitter及AG's News共6个数据集。结果表明,暴露步骤显著提升各类下游任务性能,包括后门标签检测、触发器恢复、模型识别与清除。代码已开源。
原文摘要 · Abstract (English)
Backdoor attacks covertly implant triggers into deep neural networks (DNNs) by poisoning a small portion of the training data with pre-designed backdoor triggers. This vulnerability is exacerbated in the era of large models, where extensive (pre-)training on web-crawled datasets is susceptible to compromise. In this paper, we introduce a novel two-step defense framework named Expose Before You Defend (EBYD). EBYD unifies existing backdoor defense methods into a comprehensive defense system with enhanced performance. Specifically, EBYD first exposes the backdoor functionality in the backdoored model through a model preprocessing step called backdoor exposure, and then applies detection and removal methods to the exposed model to identify and eliminate the backdoor features. In the first step of backdoor exposure, we propose a novel technique called Clean Unlearning (CUL), which proactively unlearns clean features from the backdoored model to reveal the hidden backdoor features. We also explore various model editing/modification techniques for backdoor exposure, including fine-tuning, model sparsification, and weight perturbation. Using EBYD, we conduct extensive experiments on 10 image attacks and 6 text attacks across 2 vision datasets (CIFAR-10 and an ImageNet subset) and 4 language datasets (SST-2, IMDB, Twitter, and AG's News). The results demonstrate the importance of backdoor exposure for backdoor defense, showing that the exposed models can significantly benefit a range of downstream defense tasks, including backdoor label detection, backdoor trigger recovery, backdoor model detection, and backdoor removal. We hope our work could inspire more research in developing advanced defense frameworks with exposed models. Our code is available at: https://github.com/bboylyg/Expose-Before-You-Defend.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。