提出视频对抗训练新方法,提速近500%且提升鲁棒性
Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videos
- 用时频域增强与单步攻击提升训练效率
- 通过弱到强一致性正则实现准确率与鲁棒性平衡
- 适合需要快速部署视频模型的工业场景
对抗训练(AT)通过最小-最大优化显著提升模型抗干扰能力,但在视频识别中面临两大挑战:一是视频对抗训练方法计算成本高、训练时间长,实用性受限;二是现有方法难以兼顾干净样本准确率与对抗鲁棒性。为此,本文提出首个面向视频数据的快速对抗训练方法——VFAT-WS。该方法引入简单高效的时频域增强(TF-AUG)及其时空增强形式STF-AUG,并结合单步PGD攻击以提升训练效率与鲁棒性;同时设计弱到强空间-时序一致性正则化,使模型从简单增强逐步学习复杂增强模式。在UCF-101和HMDB-51数据集上,基于CNN与Transformer模型的实验表明,该方法在实现近490%训练加速的同时,显著提升了对抗鲁棒性与抗损坏鲁棒性。
原文摘要 · Abstract (English)
Adversarial Training (AT) has been shown to significantly enhance adversarial robustness via a min-max optimization approach. However, its effectiveness in video recognition tasks is hampered by two main challenges. First, fast adversarial training for video models remains largely unexplored, which severely impedes its practical applications. Specifically, most video adversarial training methods are computationally costly, with long training times and high expenses. Second, existing methods struggle with the trade-off between clean accuracy and adversarial robustness. To address these challenges, we introduce Video Fast Adversarial Training with Weak-to-Strong consistency (VFAT-WS), the first fast adversarial training method for video data. Specifically, VFAT-WS incorporates the following key designs: First, it integrates a straightforward yet effective temporal frequency augmentation (TF-AUG), and its spatial-temporal enhanced form STF-AUG, along with a single-step PGD attack to boost training efficiency and robustness. Second, it devises a weak-to-strong spatial-temporal consistency regularization, which seamlessly integrates the simpler TF-AUG and the more complex STF-AUG. Leveraging the consistency regularization, it steers the learning process from simple to complex augmentations. Both of them work together to achieve a better trade-off between clean accuracy and robustness. Extensive experiments on UCF-101 and HMDB-51 with both CNN and Transformer-based models demonstrate that VFAT-WS achieves great improvements in adversarial robustness and corruption robustness, while accelerating training by nearly 490%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。