arXiv:2510.27245cs.CV2025-10被引 3

用时空频联合分析提升图像抗攻击能力,让模型更稳。

Trans-defense: Transformer-based Denoiser for Adversarial Defense with Spatial-Frequency Domain Representation

  • 用小波变换提取频域特征,结合Transformer融合空间与频率信息
  • 在MNIST/CIFAR-10/Fashion-MNIST上准确率显著超越传统去噪和对抗训练
  • 适合安全敏感场景的鲁棒模型构建,尤其关注图像防御

近年来,深度神经网络(DNN)在诸多应用中表现优异,但其易受复杂对抗攻击影响,限制了在安全关键系统中的使用。本文提出两阶段训练方法:先训练去噪网络,再训练分类器。提出一种结合空间与频率域的新颖去噪策略,分析发现被攻击图像的高频分量受损更严重。为此,采用离散小波变换(DWT)进行频域分析,并设计基于Transformer的去噪网络,融合空间图像特征与小波系数。随后使用去噪后的图像重新训练分类器,提升其对对抗攻击的鲁棒性。在MNIST、CIFAR-10和Fashion-MNIST数据集上的实验表明,该方法显著提升分类准确率,大幅优于仅使用去噪网络或对抗训练的方法。代码已公开于https://github.com/Mayank94/Trans-Defense。

原文摘要 · Abstract (English)

In recent times, deep neural networks (DNNs) have been successfully adopted for various applications. Despite their notable achievements, it has become evident that DNNs are vulnerable to sophisticated adversarial attacks, restricting their applications in security-critical systems. In this paper, we present two-phase training methods to tackle the attack: first, training the denoising network, and second, the deep classifier model. We propose a novel denoising strategy that integrates both spatial and frequency domain approaches to defend against adversarial attacks on images. Our analysis reveals that high-frequency components of attacked images are more severely corrupted compared to their lower-frequency counterparts. To address this, we leverage Discrete Wavelet Transform (DWT) for frequency analysis and develop a denoising network that combines spatial image features with wavelets through a transformer layer. Next, we retrain the classifier using the denoised images, which enhances the classifier's robustness against adversarial attacks. Experimental results across the MNIST, CIFAR-10, and Fashion-MNIST datasets reveal that the proposed method remarkably elevates classification accuracy, substantially exceeding the performance by utilizing a denoising network and adversarial training approaches. The code is available at https://github.com/Mayank94/Trans-Defense.

图像防御Transformer小波变换对抗样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。