arXiv:2604.22853cs.CVcs.LG2026-04

建立公平对比框架,验证快速对抗训练的真实效果

FastAT Benchmark: A Comprehensive Framework for Fair Evaluation of Fast Adversarial Training Methods

  • 统一模型架构与训练配置,禁用外部数据
  • 20+方法对比显示单步法可低耗达强鲁棒性
  • 开源完整代码与结果,推动透明评估

快速对抗训练(FastAT)旨在以远低于标准多步方法(如PGD-AT)的计算成本实现对抗鲁棒性。尽管近年提出众多FastAT方法,但因模型架构、训练配置和外部数据使用差异过大,现有评测难以公平比较。为此,本文提出FastAT Benchmark,基于三项核心设计原则:统一架构要求、标准化训练设置、严格禁止外部或合成数据。该框架在单一代码库中实现超过二十种代表性FastAT方法,支持直接可复现对比。每种方法通过双指标评估:对抗鲁棒性(PGD、AutoAttack、CR Attack下的准确率)与计算成本(GPU训练时间、峰值内存占用)。在CIFAR-10、CIFAR-100和Tiny-ImageNet上的全面实验表明,设计良好的单步方法可在显著更低成本下达到甚至超越PGD-AT的鲁棒性,但无单一方法在所有维度上占优。完整基准测试代码、配置文件及实验结果已公开,以支持未来FastAT研究的透明、公正评估。

原文摘要 · Abstract (English)

Fast Adversarial Training (FastAT) seeks to achieve adversarial robustness at a fraction of the computational cost incurred by standard multi-step methods such as PGD-AT. Although numerous FastAT techniques have been proposed in recent years, fair comparison among them remains elusive. Existing benchmarks and public leaderboards typically permit diverse model architectures, varying training configurations, and external data sources, making it unclear whether reported improvements reflect genuine algorithmic advances or merely more favorable experimental conditions. To address this problem, we introduce the FastAT Benchmark, a controlled evaluation framework built on three core design principles: unified architecture requirements, standardized training settings, and strict prohibition of external or synthetic data. The benchmark implements over twenty representative FastAT methods within a single codebase, enabling direct and reproducible comparison. Each method is assessed through a dual-metric evaluation framework that measures both adversarial robustness (accuracy under PGD, AutoAttack, and CR Attack) and computational cost (GPU training time and peak memory footprint). Comprehensive experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet provide reliable baseline measurements and reveal that well-designed single-step methods can match or surpass PGD-AT robustness at substantially lower cost, while no single method dominates across all evaluation dimensions. The complete benchmark, including source code, configuration files, and experimental results, is publicly available to support transparent and fair evaluation of future FastAT research.

对抗训练公平评估高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。