arXiv:2502.05542cs.LG2025-02ICLR被引 1

通过提升模型特征民主性,有效防御通用对抗扰动。

Democratic Training Against Universal Adversarial Perturbations

  • 基于隐藏层熵谱异常,设计熵增强训练机制。
  • 在5个数据集上降低攻击成功率,保持原准确率。
  • 适合部署于高安全场景的深度模型防御。

尽管深度神经网络取得了显著进展,但在现实应用中仍易受对抗攻击影响。通用对抗扰动(UAP)作为一种与输入无关的攻击方式,对安全敏感系统构成严重威胁:单一扰动即可欺骗模型在多种正常输入上的表现,且无需针对每个输入进行优化。本文观察到,当受到UAP影响时,模型隐藏层的特征熵谱呈现异常,表明预测仅依赖少数特征,而非民主化地利用多特征。受此启发,我们提出一种名为「民主训练」(Democratic Training)的高效防御方法,通过熵基增强机制抑制通用对抗扰动的影响。该方法在7种神经网络、5个基准数据集及5类前沿的UAP攻击方法上进行了评估,结果表明其能显著降低攻击成功率,提升模型鲁棒性,同时保持在干净样本上的原始准确率。

原文摘要 · Abstract (English)

Despite their advances and success, real-world deep neural networks are known to be vulnerable to adversarial attacks. Universal adversarial perturbation, an input-agnostic attack, poses a serious threat for them to be deployed in security-sensitive systems. In this case, a single universal adversarial perturbation deceives the model on a range of clean inputs without requiring input-specific optimization, which makes it particularly threatening. In this work, we observe that universal adversarial perturbations usually lead to abnormal entropy spectrum in hidden layers, which suggests that the prediction is dominated by a small number of ``feature'' in such cases (rather than democratically by many features). Inspired by this, we propose an efficient yet effective defense method for mitigating UAPs called \emph{Democratic Training} by performing entropy-based model enhancement to suppress the effect of the universal adversarial perturbations in a given model. \emph{Democratic Training} is evaluated with 7 neural networks trained on 5 benchmark datasets and 5 types of state-of-the-art universal adversarial attack methods. The results show that it effectively reduces the attack success rate, improves model robustness and preserves the model accuracy on clean samples.

对抗攻击模型鲁棒性训练方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。