arXiv:2505.19613cs.CV2025-05被引 3

TESSER提升ViT攻击跨模型迁移能力,让黑盒攻击更有效。

TESSER: Transfer-Enhancing Adversarial Attacks from Vision Transformers via Spectral and Semantic Regularization

  • 基于特征重要性动态调整梯度,生成更具语义意义的扰动。
  • 引入频谱平滑正则,使扰动能量降低12%的高频成分。
  • 在12种模型上超越现有方法,尤其对防御模型攻击成功率超53%。

对抗性迁移性仍是评估深度神经网络鲁棒性的关键挑战。在安全关键应用中,迁移性使攻击者无需访问模型内部即可实施黑盒攻击,因此对现实世界的对抗威胁评估至关重要。尽管视觉变换器(ViTs)表现出强大的对抗性能,但现有攻击方法在跨架构迁移方面表现不佳,尤其是在从ViTs向卷积神经网络(CNNs)或混合模型迁移时。本文提出 extbf{TESSER}——一种新型对抗攻击框架,通过两项核心策略增强迁移性:(1) extit{特征敏感梯度缩放(FSGS)},根据中间特征激活的逐标记重要性调节梯度;(2) extit{谱平滑正则化(SSR)},利用可微高斯先验抑制扰动中的高频噪声。这两项机制协同作用,生成既具语义意义又频谱平滑的扰动。在ImageNet上对12种不同架构的大量实验表明,TESSER相比最先进的自适应标记调优(ATT)方法,在CNN上实现+10.9%的攻击成功率(ASR),在ViTs上实现+7.2%的提升。此外,TESSER显著提升了对防御模型的攻击能力,在对抗训练的CNN上达到53.55%的ASR。定性分析显示,TESSER的扰动与Grad-CAM识别的显著视觉区域高度一致,频域分析证实高频能量减少12%,验证了谱正则化的有效性。

原文摘要 · Abstract (English)

Adversarial transferability remains a critical challenge in evaluating the robustness of deep neural networks. In security-critical applications, transferability enables black-box attacks without access to model internals, making it a key concern for real-world adversarial threat assessment. While Vision Transformers (ViTs) have demonstrated strong adversarial performance, existing attacks often fail to transfer effectively across architectures, especially from ViTs to Convolutional Neural Networks (CNNs) or hybrid models. In this paper, we introduce \textbf{TESSER} -- a novel adversarial attack framework that enhances transferability via two key strategies: (1) \textit{Feature-Sensitive Gradient Scaling (FSGS)}, which modulates gradients based on token-wise importance derived from intermediate feature activations, and (2) \textit{Spectral Smoothness Regularization (SSR)}, which suppresses high-frequency noise in perturbations using a differentiable Gaussian prior. These components work in tandem to generate perturbations that are both semantically meaningful and spectrally smooth. Extensive experiments on ImageNet across 12 diverse architectures demonstrate that TESSER achieves +10.9\% higher attack succes rate (ASR) on CNNs and +7.2\% on ViTs compared to the state-of-the-art Adaptive Token Tuning (ATT) method. Moreover, TESSER significantly improves robustness against defended models, achieving 53.55\% ASR on adversarially trained CNNs. Qualitative analysis shows strong alignment between TESSER's perturbations and salient visual regions identified via Grad-CAM, while frequency-domain analysis reveals a 12\% reduction in high-frequency energy, confirming the effectiveness of spectral regularization.

对抗攻击视觉变换器迁移性频谱正则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。