提出随机采样增强扩散模型抗攻击能力,性能超越现有方法。
Random Sampling for Diffusion-based Adversarial Purification
- 用随机噪声空间采样替代连续采样,提升鲁棒性
- 在强攻击下比SOTA高出20%以上鲁棒性,采样加速10倍
- 适合需要高效防御的图像净化场景
去噪扩散概率模型(DDPM)在对抗净化中受到广泛关注。现有基于扩散的方法侧重于设计有效的条件引导机制,却忽略了原始DDPM采样旨在稳定生成,未必适合对抗净化。受去噪扩散隐式模型(DDIM)稳定性的启发,我们提出一种相反的采样策略——随机采样:在每次扩散过程中从随机噪声空间采样,而非像DDPM和DDIM那样连续从相邻或原始噪声空间采样。这种策略增强了随机性,从而提升了对对抗攻击的鲁棒性。同时,引入新型中介条件引导机制,确保净化后图像与干净输入下的预测一致性。通过对比不同采样方法的详尽评估,我们的随机采样在多种设置下均表现优异。基于中介引导的随机采样,我们建立了一个名为DiffAP的基准方法,在性能和防御稳定性上显著优于当前最先进(SOTA)方法。值得注意的是,在强攻击下,DiffAP实现超过20%的鲁棒性提升,并具备10倍的采样加速优势。
原文摘要 · Abstract (English)
Denoising Diffusion Probabilistic Models (DDPMs) have gained great attention in adversarial purification. Current diffusion-based works focus on designing effective condition-guided mechanisms while ignoring a fundamental problem, i.e., the original DDPM sampling is intended for stable generation, which may not be the optimal solution for adversarial purification. Inspired by the stability of the Denoising Diffusion Implicit Model (DDIM), we propose an opposite sampling scheme called random sampling. In brief, random sampling will sample from a random noisy space during each diffusion process, while DDPM and DDIM sampling will continuously sample from the adjacent or original noisy space. Thus, random sampling obtains more randomness and achieves stronger robustness against adversarial attacks. Correspondingly, we also introduce a novel mediator conditional guidance to guarantee the consistency of the prediction under the purified image and clean image input. To expand awareness of guided diffusion purification, we conduct a detailed evaluation with different sampling methods and our random sampling achieves an impressive improvement in multiple settings. Leveraging mediator-guided random sampling, we also establish a baseline method named DiffAP, which significantly outperforms state-of-the-art (SOTA) approaches in performance and defensive stability. Remarkably, under strong attack, our DiffAP even achieves a more than 20% robustness advantage with 10$\times$ sampling acceleration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。