arXiv:2505.01267cs.CV2025-05ICML被引 12

从频域角度优化对抗净化,更好保留图像细节。

Diffusion-based Adversarial Purification from the Perspective of the Frequency Domain

  • 在反向扩散过程中,按频域特性分量修复图像
  • 低频部分替换或投影,有效抑制对抗扰动
  • 适合需要高保真度的图像防御场景

基于扩散的对抗净化方法通过前向过程将对抗扰动转化为各向同性噪声,并在反向过程中恢复干净图像。由于在像素域缺乏对抗扰动的分布信息,常导致正常语义受损。本文转向频域视角,将图像分解为幅度谱和相位谱,发现二者受对抗扰动的影响均随频率单调上升。因此,可从损伤较小的低频成分中提取原始样本的内容与结构信息。理论分析表明,现有净化方法对所有频率成分无差别处理,造成过度破坏。为此,本文提出一种新方法:在反向过程每一步,对幅度谱,用对抗图像对应低频部分替换估计图像的低频;对相位谱,将估计图像的相位投影至对抗图像相位谱的指定低频区间。大量实验证明,该方法显著优于当前多数防御方法。

原文摘要 · Abstract (English)

The diffusion-based adversarial purification methods attempt to drown adversarial perturbations into a part of isotropic noise through the forward process, and then recover the clean images through the reverse process. Due to the lack of distribution information about adversarial perturbations in the pixel domain, it is often unavoidable to damage normal semantics. We turn to the frequency domain perspective, decomposing the image into amplitude spectrum and phase spectrum. We find that for both spectra, the damage caused by adversarial perturbations tends to increase monotonically with frequency. This means that we can extract the content and structural information of the original clean sample from the frequency components that are less damaged. Meanwhile, theoretical analysis indicates that existing purification methods indiscriminately damage all frequency components, leading to excessive damage to the image. Therefore, we propose a purification method that can eliminate adversarial perturbations while maximizing the preservation of the content and structure of the original image. Specifically, at each time step during the reverse process, for the amplitude spectrum, we replace the low-frequency components of the estimated image's amplitude spectrum with the corresponding parts of the adversarial image. For the phase spectrum, we project the phase of the estimated image into a designated range of the adversarial image's phase spectrum, focusing on the low frequencies. Empirical evidence from extensive experiments demonstrates that our method significantly outperforms most current defense methods.

对抗净化频域分析扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。