提出新框架提升模型在对抗攻击下的准确率与鲁棒性
Deep Positive-Negative Prototypes for Adversarially Robust Discriminative Prototypical Learning
- 用统一原型同时作为分类器权重和鲁棒锚点,增强特征空间结构
- 双分支训练:原型仅用干净数据更新,提取器用对抗样本训练
- 复合损失函数提升分类清晰度、对抗鲁棒性和原始准确率
尽管判别性原型方法具有优势,但其在对抗鲁棒性方面的潜力尚未充分探索。现有对抗训练方法通常忽略潜在空间的几何结构,导致原始数据准确率下降。本文提出新型框架Adv-DPNP,融合判别性原型学习与对抗训练。该框架使用统一类别原型,既作为分类器权重,又作为潜在空间中的鲁棒锚点。通过双分支训练机制,仅用干净数据更新原型,而特征提取器则在干净和对抗样本上训练,以增强对对抗扰动的不变性。此外,采用复合损失函数,结合正原型对齐、负原型排斥与一致性正则化,进一步提升判别能力、对抗鲁棒性和干净数据准确率。在CIFAR-10/100与SVHN等标准基准上实验表明,Adv-DPNP在保持或超越现有防御方法鲁棒性的前提下,显著提升干净数据准确率。在CIFAR-10-C上的常见损坏测试中,其平均准确率在各类严重程度与损坏类型中均居首位。深入分析显示,该方法有效维持了潜在空间中特征表示的紧凑性与清晰分离。
原文摘要 · Abstract (English)
Despite the advantages of discriminative prototype-based methods, their role in adversarial robustness remains underexplored. Meanwhile, current adversarial training methods predominantly focus on robustness against adversarial attacks without explicitly leveraging geometric structures in the latent space, usually resulting in reduced accuracy on the original clean data. We propose a novel framework named Adversarially trained Deep Positive-Negative Prototypes (Adv-DPNP), which integrates discriminative prototype-based learning with adversarial training. Adv-DPNP uses unified class prototypes that serve as both classifier weights and robust anchors in the latent space. Moreover, a novel dual-branch training mechanism maintains stable prototypes by updating them exclusively with clean data, while the feature extractor is trained on both clean and adversarial inputs to increase invariance to adversarial perturbations. In addition, we use a composite loss that combines positive-prototype alignment, negative-prototype repulsion, and consistency regularization to further enhance discrimination, adversarial robustness, and clean accuracy. Extensive experiments on standard benchmarks (CIFAR-10/100 and SVHN) confirm that Adv-DPNP improves clean accuracy over state-of-the-art defenses and baseline methods, while maintaining competitive or superior robustness under a suite of widely used attacks, including FGSM, PGD, C\&W, and AutoAttack. We also evaluate robustness to common corruptions on CIFAR-10-C, where Adv-DPNP achieves the highest average accuracy across severities and corruption types. Additionally, we provide an in-depth analysis of the discriminative quality of the learned feature representations, highlighting the effectiveness of Adv-DPNP in maintaining compactness and clear separation in the latent space.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。