无需额外数据,仅微调分类层即可有效防御后门攻击。
PAD-FT: A Lightweight Defense for Backdoor Attacks via Data Purification and Fine-Tuning
- 通过数据净化筛选出最可能干净的样本,构建自净化数据集。
- 仅对模型最后分类层进行微调,计算开销极低。
- 在多种攻击和数据集上表现优异,适合资源受限场景。
后门攻击对深度神经网络构成严重威胁,尤其随着攻击手段日益隐蔽,防御难度加大。现有防御方法通常依赖额外的干净数据集,并需重新训练辅助模型或微调整个受害者模型,计算成本高且难以实际应用。本文提出一种新型轻量级防御机制PAD-FT,无需额外干净数据集,仅微调模型极小部分即可净化受污染模型。该方法首先通过简单数据净化流程,从被污染训练集中识别并选取最可能干净的数据;随后利用自净化数据集进行激活裁剪,并仅对受害者模型的最后一层分类器进行微调。通过整合数据净化、激活裁剪与分类器微调,PAD-FT在多种后门攻击方法与数据集上均展现出卓越效果,经广泛实验验证。
原文摘要 · Abstract (English)
Backdoor attacks pose a significant threat to deep neural networks, particularly as recent advancements have led to increasingly subtle implantation, making the defense more challenging. Existing defense mechanisms typically rely on an additional clean dataset as a standard reference and involve retraining an auxiliary model or fine-tuning the entire victim model. However, these approaches are often computationally expensive and not always feasible in practical applications. In this paper, we propose a novel and lightweight defense mechanism, termed PAD-FT, that does not require an additional clean dataset and fine-tunes only a very small part of the model to disinfect the victim model. To achieve this, our approach first introduces a simple data purification process to identify and select the most-likely clean data from the poisoned training dataset. The self-purified clean dataset is then used for activation clipping and fine-tuning only the last classification layer of the victim model. By integrating data purification, activation clipping, and classifier fine-tuning, our mechanism PAD-FT demonstrates superior effectiveness across multiple backdoor attack methods and datasets, as confirmed through extensive experimental evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。