arXiv:2501.13336cs.CVeess.IV2025-01被引 3

用无梯度方法提升模型抗攻击能力,兼顾效率与泛化性。

Gradient-Free Adversarial Purification with Diffusion Models

  • 基于像素级扰动抑制和图像修复的无训练净化策略
  • 对受限与非受限攻击均有效,且无需重训练模型
  • 适合需要快速部署且资源有限的防御场景

对抗训练与对抗净化是提升模型对抗攻击鲁棒性的常用策略。然而,对抗训练需大量重训练,而对抗净化常效率低下。更关键的是,现有防御主要针对基于扰动的攻击,在面对近年出现的无限制攻击时效果不佳。本文提出一种高效且有效的防御框架,可应对两类攻击。受制于对抗样本通常靠近决策边界且对像素级扰动敏感的观察,我们引入对抗抗混叠(adversarial anti-aliasing)技术,通过降低像素级扰动幅度来抑制对抗噪声;同时提出对抗超分辨率(adversarial super-resolution),利用干净数据集先验,从受损图像中恢复高质量图像。该方法专注于图像修复而非生成新图,更适用于净化任务。两者均无需额外训练且不依赖梯度计算,因此计算高效。为进一步提升跨数据集的鲁棒性,我们引入基于对比学习的对抗去模糊微调方法,通过在目标数据集上融合对抗先验进行微调,增强净化效果,无需重新训练扩散模型。

原文摘要 · Abstract (English)

Adversarial training and adversarial purification are two widely used defense strategies for enhancing model robustness against adversarial attacks. However, adversarial training requires costly retraining, while adversarial purification often suffers from low efficiency. More critically, existing defenses are primarily designed under the perturbation-based adversarial threat model, which is ineffective against recently introduced unrestricted adversarial attacks. In this paper, we propose an effective and efficient defense framework that counters both perturbation-based and unrestricted adversarial attacks. Our approach is motivated by the observation that adversarial examples typically lie near the decision boundary and are highly sensitive to pixel-level perturbations. To address this, we introduce adversarial anti-aliasing, a preprocessing technique that mitigates adversarial noise by reducing the magnitude of pixel-level perturbations. In addition, we propose adversarial super-resolution, which leverages prior knowledge from clean datasets to benignly restore high-quality images from adversarially degraded ones. Unlike image synthesis methods that generate entirely new images, adversarial super-resolution focuses on image restoration, making it more suitable for purification. Importantly, both techniques require no additional training and are computationally efficient since they do not rely on gradient computations. To further improve robustness across diverse datasets, we introduce a contrastive learning-based adversarial deblurring fine-tuning method. By incorporating adversarial priors during fine-tuning on the target dataset, this method enhances purification effectiveness without the need to retrain diffusion models.

对抗防御扩散模型无梯度图像净化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。