用固定触发器让模型对迁移攻击更鲁棒,干净数据乱猜但带触发器就准。
Towards Model Resistant to Transferable Adversarial Examples via Trigger Activation
- 设计带固定触发器的模型,干净输入时随机输出,加触发器后准确预测。
- 在多个数据集和攻击方法下,对迁移攻击的防御效果显著优于现有方法。
- 理论分析揭示梯度特性带来鲁棒性,适合需要强对抗防御的场景。
对抗样本以难以察觉的扰动误导深度神经网络,其迁移性使其能在黑盒场景中欺骗未见模型。尽管已有多种防御方法,仍存在部署效率低、防御无效、对干净样本性能下降等问题。本文提出一种新训练范式,通过引入固定触发器($oldsymbolτ$),使模型在输入干净数据 $oldsymbol{x}$ 时表现为随机猜测,在输入带触发器的数据 $oldsymbol{x}+oldsymbolτ$ 时则能准确预测。这类模型称为“触发激活模型”。我们意外发现此类模型对迁移对抗样本具备一定鲁棒性。通过一阶梯度分析提供理论解释,并联合优化可学习触发器与模型参数,进一步提升对迁移攻击的抵抗力。大量实验在多个数据集上验证了该方法的有效性与优越性。
原文摘要 · Abstract (English)
Adversarial examples, characterized by imperceptible perturbations, pose significant threats to deep neural networks by misleading their predictions. A critical aspect of these examples is their transferability, allowing them to deceive {unseen} models in black-box scenarios. Despite the widespread exploration of defense methods, including those on transferability, they show limitations: inefficient deployment, ineffective defense, and degraded performance on clean images. In this work, we introduce a novel training paradigm aimed at enhancing robustness against transferable adversarial examples (TAEs) in a more efficient and effective way. We propose a model that exhibits random guessing behavior when presented with clean data $\boldsymbol{x}$ as input, and generates accurate predictions when with triggered data $\boldsymbol{x}+\boldsymbolτ$. Importantly, the trigger $\boldsymbolτ$ remains constant for all data instances. We refer to these models as \textbf{models with trigger activation}. We are surprised to find that these models exhibit certain robustness against TAEs. Through the consideration of first-order gradients, we provide a theoretical analysis of this robustness. Moreover, through the joint optimization of the learnable trigger and the model, we achieve improved robustness to transferable attacks. Extensive experiments conducted across diverse datasets, evaluating a variety of attacking methods, underscore the effectiveness and superiority of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。