arXiv:2508.12384cs.CVcs.CR2025-08ICCV被引 5

通过增强ViT模型提升对抗样本迁移性,首个专为ViT设计的集成攻击方法。

ViT-EnsembleAttack: Augmenting Ensemble Models for Stronger Adversarial Transferability in Vision Transformers

  • 对ViT代理模型进行对抗增强,提升集成模型泛化能力。
  • 在多个ViT上实现显著更高的对抗迁移成功率,优于现有方法。
  • 适合研究视觉变压器安全性的研究人员使用。

基于集成的攻击已被证明可通过聚合不同架构模型的输出来增强对抗样本的迁移性。然而,现有研究主要聚焦于优化集成权重或路径,忽略了探索集成模型本身以提升攻击迁移性。为此,我们提出对代理模型施加对抗增强,旨在提升集成模型的整体泛化能力并降低对抗过拟合风险。同时,鉴于集成视觉变换器(ViTs)未受足够关注,我们提出了首个面向ViTs的集成攻击方法——ViT-EnsembleAttack。该方法通过三种策略(多头丢弃、注意力分数缩放、MLP特征混合)对每个代理ViT生成增强模型,并利用贝叶斯优化调整相关参数。这些增强模型被集成以生成对抗样本。此外,引入自动重加权和步长放大模块进一步提升迁移性。大量实验表明,ViT-EnsembleAttack显著增强了基于集成的攻击在ViTs上的对抗迁移性,性能远超现有方法。代码已公开于https://github.com/Trustworthy-AI-Group/TransferAttack。

原文摘要 · Abstract (English)

Ensemble-based attacks have been proven to be effective in enhancing adversarial transferability by aggregating the outputs of models with various architectures. However, existing research primarily focuses on refining ensemble weights or optimizing the ensemble path, overlooking the exploration of ensemble models to enhance the transferability of adversarial attacks. To address this gap, we propose applying adversarial augmentation to the surrogate models, aiming to boost overall generalization of ensemble models and reduce the risk of adversarial overfitting. Meanwhile, observing that ensemble Vision Transformers (ViTs) gain less attention, we propose ViT-EnsembleAttack based on the idea of model adversarial augmentation, the first ensemble-based attack method tailored for ViTs to the best of our knowledge. Our approach generates augmented models for each surrogate ViT using three strategies: Multi-head dropping, Attention score scaling, and MLP feature mixing, with the associated parameters optimized by Bayesian optimization. These adversarially augmented models are ensembled to generate adversarial examples. Furthermore, we introduce Automatic Reweighting and Step Size Enlargement modules to boost transferability. Extensive experiments demonstrate that ViT-EnsembleAttack significantly enhances the adversarial transferability of ensemble-based attacks on ViTs, outperforming existing methods by a substantial margin. Code is available at https://github.com/Trustworthy-AI-Group/TransferAttack.

视觉变压器对抗攻击集成方法迁移性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。