arXiv:2509.07673cs.CVcs.LG2025-09

通过移除最近邻投影提升模型抗攻击能力

Nearest Neighbor Projection Removal Adversarial Training

  • 识别对抗样本的最近邻类别并移除其特征投影
  • 在多个数据集上实现高鲁棒性与高准确率
  • 适合关注模型安全性与特征分离的研究者

深度神经网络在图像分类任务中表现优异,但对对抗样本仍敏感。标准对抗训练虽能增强鲁棒性,却未显式处理类别间特征重叠这一关键问题。本文提出一种新框架,通过在特征空间中将对抗样本和干净样本的类间依赖关系投影出去,主动缓解类别间邻近问题。具体而言,先定位每个对抗样本的最近邻类别,再移除其在该邻近方向上的投影,从而强化特征可分性。理论上证明,所提逻辑修正可降低神经网络的Lipschitz常数,减少Rademacher复杂度,直接促进泛化与鲁棒性。在CIFAR-10、CIFAR-100、SVHN和TinyImageNet等标准数据集上的实验表明,该方法性能优于现有主流对抗训练技术,在鲁棒准确率与干净准确率方面均有显著提升。结果表明,显式处理类别间特征邻近是提升DNN对抗鲁棒性的关键。

原文摘要 · Abstract (English)

Deep neural networks have exhibited impressive performance in image classification tasks but remain vulnerable to adversarial examples. Standard adversarial training enhances robustness but typically fails to explicitly address inter-class feature overlap, a significant contributor to adversarial susceptibility. In this work, we introduce a novel adversarial training framework that actively mitigates inter-class proximity by projecting out inter-class dependencies from adversarial and clean samples in the feature space. Specifically, our approach first identifies the nearest inter-class neighbors for each adversarial sample and subsequently removes projections onto these neighbors to enforce stronger feature separability. Theoretically, we demonstrate that our proposed logits correction reduces the Lipschitz constant of neural networks, thereby lowering the Rademacher complexity, which directly contributes to improved generalization and robustness. Extensive experiments across standard benchmarks including CIFAR-10, CIFAR-100, SVHN, and TinyImagenet show that our method demonstrates strong performance that is competitive with leading adversarial training techniques, highlighting significant achievements in both robust and clean accuracy. Our findings reveal the importance of addressing inter-class feature proximity explicitly to bolster adversarial robustness in DNNs. The code is available in the supplementary material.

对抗训练特征分离鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。