通过可控边界插值提升低标签场景下的模型鲁棒性与准确率
Adversarial Training in Low-Label Regimes with Margin-Based Interpolation
- 用干净样本与对抗样本线性插值生成跨边界的对抗样本
- 在低标签数据下对PGD、AutoAttack攻击提升显著,兼顾自然准确率
- 适合关注对抗训练与半监督学习的科研人员
对抗训练已成为提升神经网络模型抗对抗攻击能力的有效方法,即使在标注数据稀缺的低标签场景中也表现出色。本文提出一种新型半监督对抗训练方法,通过生成有效对抗样本来同时提升模型的鲁棒性和自然准确率。该方法首先对干净样本与对抗样本进行线性插值,生成跨越决策边界的插值对抗样本,且控制其穿越边界的边际。这种样本感知策略根据每个数据点特征定制对抗样本,使模型能从最具信息量的扰动中学习。此外,我们提出全局ε调度策略,在训练过程中逐步调整扰动强度上限。上述策略结合使用,使模型能够构建更复杂的决策边界,从而实现更强的鲁棒性和更高的自然准确率。实验表明,该方法在多种对抗攻击(如PGD、AutoAttack)下均显著提升性能。
原文摘要 · Abstract (English)
Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel semi-supervised adversarial training approach that enhances both robustness and natural accuracy by generating effective adversarial examples. Our method begins by applying linear interpolation between clean and adversarial examples to create interpolated adversarial examples that cross decision boundaries by a controlled margin. This sample-aware strategy tailors adversarial examples to the characteristics of each data point, enabling the model to learn from the most informative perturbations. Additionally, we propose a global epsilon scheduling strategy that progressively adjusts the upper bound of perturbation strengths during training. The combination of these strategies allows the model to develop increasingly complex decision boundaries with better robustness and natural accuracy. Empirical evaluations show that our approach effectively enhances performance against various adversarial attacks, such as PGD and AutoAttack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。