arXiv:2503.01924cs.LGcs.AI2025-03CVPR被引 14

针对长尾分布下的模型鲁棒性问题,提出两阶段对抗均衡训练框架。

TAET: Two-Stage Adversarial Equalization Training on Long-Tailed Distributions

  • 先稳定后分层均衡的两阶段对抗训练策略
  • 在长尾数据上显著提升鲁棒性与平衡准确率
  • 适合真实场景中类别不均衡的模型安全防护

对抗鲁棒性是深度神经网络在真实应用中面临的关键挑战。尽管对抗训练是主流防御方法,但现有研究多聚焦于均衡数据集,忽略了真实数据中普遍存在的长尾分布,这极大增加了鲁棒性实现的难度。本文全面分析了长尾分布下的对抗训练,发现当前最先进的AT-BSL方法在此条件下性能受限。为此,我们提出新框架TAET,包含初始稳定阶段与分层均衡对抗训练阶段。此外,以往研究忽视了平衡准确率这一关键评估指标,因此我们引入平衡鲁棒性,专用于评估长尾分布下的鲁棒性表现。大量实验表明,该方法在内存和计算效率上均优于现有先进防御,显著提升性能。代码已开源。

原文摘要 · Abstract (English)

Adversarial robustness is a critical challenge in deploying deep neural networks for real-world applications. While adversarial training is a widely recognized defense strategy, most existing studies focus on balanced datasets, overlooking the prevalence of long-tailed distributions in real-world data, which significantly complicates robustness. This paper provides a comprehensive analysis of adversarial training under long-tailed distributions and identifies limitations in the current state-of-the-art method, AT-BSL, in achieving robust performance under such conditions. To address these challenges, we propose a novel training framework, TAET, which integrates an initial stabilization phase followed by a stratified equalization adversarial training phase. Additionally, prior work on long-tailed robustness has largely ignored the crucial evaluation metric of balanced accuracy. To bridge this gap, we introduce the concept of balanced robustness, a comprehensive metric tailored for assessing robustness under long-tailed distributions. Extensive experiments demonstrate that our method surpasses existing advanced defenses, achieving significant improvements in both memory and computational efficiency. This work represents a substantial advancement in addressing robustness challenges in real-world applications. Our code is available at: https://github.com/BuhuiOK/TAET-Two-Stage-Adversarial-Equalization-Training-on-Long-Tailed-Distributions.

对抗训练长尾分布鲁棒性平衡准确率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。