通过硬样本对比学习提升模型对抗攻击鲁棒性。
ANCHOR: Integrating Adversarial Training with Hard-mined Supervised Contrastive Learning for Robust Representation Learning
- 结合对抗训练与硬正样本对比学习,增强特征稳定性。
- 在CIFAR-10上PGD-20攻击下,清洁准确率与鲁棒准确率均优于传统方法。
- 适合关注模型安全性与表示学习的研究者参考。
神经网络通过梯度调整参数来学习数据中的判别模式,但这也使其易受对抗攻击影响——微小、人眼不可见的扰动可导致模型错误分类。本文提出ANCHOR框架,将监督对比学习与显式硬正样本挖掘结合,使同一类图像、其增强版本及扰动版本的嵌入在嵌入空间中聚类,而与不同类别分离。该机制帮助模型聚焦于稳定语义特征而非脆弱梯度线索。在CIFAR-10数据集上,该方法在PGD-20(ε=0.031)攻击下实现了优于标准对抗训练的清洁准确率和鲁棒准确率,验证了对抗引导与硬样本对比监督协同提升表示结构化与鲁棒性的有效性。
原文摘要 · Abstract (English)
Neural networks have changed the way machines interpret the world. At their core, they learn by following gradients, adjusting their parameters step by step until they identify the most discriminant patterns in the data. This process gives them their strength, yet it also opens the door to a hidden flaw. The very gradients that help a model learn can also be used to produce small, imperceptible tweaks that cause the model to completely alter its decision. Such tweaks are called adversarial attacks. These attacks exploit this vulnerability by adding tiny, imperceptible changes to images that, while leaving them identical to the human eye, cause the model to make wrong predictions. In this work, we propose Adversarially-trained Contrastive Hard-mining for Optimized Robustness (ANCHOR), a framework that leverages the power of supervised contrastive learning with explicit hard positive mining to enable the model to learn representations for images such that the embeddings for the images, their augmentations, and their perturbed versions cluster together in the embedding space along with those for other images of the same class while being separated from images of other classes. This alignment helps the model focus on stable, meaningful patterns rather than fragile gradient cues. On CIFAR-10, our approach achieves impressive results for both clean and robust accuracy under PGD-20 (epsilon = 0.031), outperforming standard adversarial training methods. Our results indicate that combining adversarial guidance with hard-mined contrastive supervision helps models learn more structured and robust representations, narrowing the gap between accuracy and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。