通过融合多种数据增强策略,高效提升模型抗对抗攻击能力。
The Power of Many: Synergistic Unification of Diverse Augmentations for Efficient Adversarial Robustness
- 提出UAA框架,离线预生成通用扰动,训练时快速应用。
- 在多个基准上达到数据增强类防御新SOTA,无需在线生成对抗样本。
- 适合追求高效鲁棒训练的工业与研究场景。
对抗扰动对深度学习模型构成严重威胁。对抗训练(AT)作为主流防御方法,面临计算成本高和标准性能下降的问题。尽管数据增强提供替代路径,但现有技术要么增益有限,要么训练开销大。因此,开发兼具高效性与强鲁棒性的防御机制至关重要。本文系统分析了现有增强技术,发现多样策略间的协同效应——而非单一方法——是提升鲁棒性的关键。基于此,提出通用对抗增强器(UAA)框架,具有即插即用特性与训练效率优势。UAA将昂贵的扰动生成过程离线预计算,生成通用变换,训练时高效为每一样本生成独特对抗扰动。大量实验验证了UAA的有效性:在多个基准上建立基于数据增强的防御新SOTA,且无需训练时在线生成对抗样本。该框架为构建鲁棒模型提供了实用高效的路径。代码见附录。
原文摘要 · Abstract (English)
Adversarial perturbations pose a significant threat to deep learning models. Adversarial Training (AT), the predominant defense method, faces challenges of high computational costs and a degradation in standard performance. While data augmentation offers an alternative path, existing techniques either yield limited robustness gains or incur substantial training overhead. Therefore, developing a defense mechanism that is both highly efficient and strongly robust is of paramount importance.In this work, we first conduct a systematic analysis of existing augmentation techniques, revealing that the synergy among diverse strategies -- rather than any single method -- is crucial for enhancing robustness. Based on this insight, we propose the Universal Adversarial Augmenter (UAA) framework, which is characterized by its plug-and-play nature and training efficiency. UAA decouples the expensive perturbation generation process from model training by pre-computing a universal transformation offline, which is then used to efficiently generate unique adversarial perturbations for each sample during training.Extensive experiments conducted on multiple benchmarks validate the effectiveness of UAA. The results demonstrate that UAA establishes a new state-of-the-art (SOTA) for data-augmentation-based adversarial defense strategies , without requiring the online generation of adversarial examples during training. This framework provides a practical and efficient pathway for building robust models,Our code is available in the supplementary materials.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。