arXiv:2503.01407cs.CVcs.AI2025-03

针对噪声净化中误伤正常像素的问题,提出分而治之的异质噪声策略。

Divide and Conquer: Heterogeneous Noise Integration for Diffusion-based Adversarial Purification

  • 根据模型关注区域差异,对关键像素施加高强噪声,其余用低强噪声
  • 在三个数据集上显著优于现有防御方法,尤其对抗强自适应攻击时表现突出
  • 重构采样流程实现单步重采样,大幅降低计算开销,适合实际部署

现有基于扩散的净化方法通过前向扩散引入噪声,再经反向过程恢复干净样本,但其对所有像素统一操作,会误伤正常像素,导致目标模型预测错误。仅依赖弱噪声无法有效防御。为此,本文提出一种基于神经网络可解释性的异质净化策略:针对目标模型关注的关键像素施加高强度噪声,其余像素仅施加低强度噪声。该设计要求重构扩散模型的采样过程,以支持不同噪声水平的灵活处理。为应对强自适应攻击,我们进一步提出单步重采样机制,在显著降低时间与内存消耗的同时保持高性能。大量实验表明,该方法在三个数据集上均大幅超越当前主流的对抗训练与净化技术。

原文摘要 · Abstract (English)

Existing diffusion-based purification methods aim to disrupt adversarial perturbations by introducing a certain amount of noise through a forward diffusion process, followed by a reverse process to recover clean examples. However, this approach is fundamentally flawed: the uniform operation of the forward process across all pixels compromises normal pixels while attempting to combat adversarial perturbations, resulting in the target model producing incorrect predictions. Simply relying on low-intensity noise is insufficient for effective defense. To address this critical issue, we implement a heterogeneous purification strategy grounded in the interpretability of neural networks. Our method decisively applies higher-intensity noise to specific pixels that the target model focuses on while the remaining pixels are subjected to only low-intensity noise. This requirement motivates us to redesign the sampling process of the diffusion model, allowing for the effective removal of varying noise levels. Furthermore, to evaluate our method against strong adaptative attack, our proposed method sharply reduces time cost and memory usage through a single-step resampling. The empirical evidence from extensive experiments across three datasets demonstrates that our method outperforms most current adversarial training and purification techniques by a substantial margin.

扩散模型对抗防御异质噪声净化方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。