arXiv:2506.04263cs.CVcs.LG2025-06

动态调整对抗训练的扰动强度,让模型更聪明地应对不同样本的攻击挑战。

Dynamic Epsilon Scheduling: A Multi-Factor Adaptive Perturbation Budget for Adversarial Training

  • 根据梯度距离、预测置信度和模型不确定性动态调节扰动大小
  • 在CIFAR-10/100上同时提升抗攻击能力与正常准确率
  • 适合追求高鲁棒性且关注模型自适应能力的研究者

对抗训练是防御深度神经网络对抗样本的有效策略之一。现有方法主要依赖固定扰动预算,未能考虑样本级的鲁棒性差异。尽管如IAAT和MMA等方法引入了实例级自适应,但多基于启发式或静态近似。本文提出动态ε调度(DES),一种按样本和训练迭代自适应调整扰动预算的新框架。DES融合三个关键因素:(1) 基于梯度代理的决策边界距离,(2) 由softmax熵导出的预测置信度,(3) 通过蒙特卡洛丢弃估计的模型不确定性。通过将这些信号整合为统一调度策略,DES能动态适配扰动预算,引导更有效的对抗学习。在CIFAR-10和CIFAR-100上的实验表明,该方法在对抗鲁棒性和标准准确率上均优于固定ε基线及先前自适应方法。此外,我们还提供了调度策略稳定性和收敛性的理论分析。本工作为实例感知、数据驱动的对抗训练开辟了新路径。

原文摘要 · Abstract (English)

Adversarial training is among the most effective strategies for defending deep neural networks against adversarial examples. A key limitation of existing adversarial training approaches lies in their reliance on a fixed perturbation budget, which fails to account for instance-specific robustness characteristics. While prior works such as IAAT and MMA introduce instance-level adaptations, they often rely on heuristic or static approximations of data robustness. In this paper, we propose Dynamic Epsilon Scheduling (DES), a novel framework that adaptively adjusts the adversarial perturbation budget per instance and per training iteration. DES integrates three key factors: (1) the distance to the decision boundary approximated via gradient-based proxies, (2) prediction confidence derived from softmax entropy, and (3) model uncertainty estimated via Monte Carlo dropout. By combining these cues into a unified scheduling strategy, DES tailors the perturbation budget dynamically to guide more effective adversarial learning. Experimental results on CIFAR-10 and CIFAR-100 show that our method consistently improves both adversarial robustness and standard accuracy compared to fixed-epsilon baselines and prior adaptive methods. Moreover, we provide theoretical insights into the stability and convergence of our scheduling policy. This work opens a new avenue for instance-aware, data-driven adversarial training methods.

对抗训练自适应优化鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。