arXiv:2606.01746cs.CVcs.LG2026-06

用混合原型提升分类器鲁棒性,兼顾判别力与抗干扰能力

Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness

论文配图:Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness
图 1 · 摘自论文原文
  • 提出基于混合原型的ℓ₂重分类器,融合稳定与动态原型
  • 在多个SOTA模型上显著提升对抗鲁棒性,无需大量微调
  • 设计新评估协议MSA,解决梯度混淆与前向不连续问题

现代神经网络极易受到对抗扰动影响。本文发现,广泛使用的全连接(FC)分类器对扰动过于敏感是其脆弱性的原因之一。相比之下,基于ℓ₂距离的分类器表现出更强的鲁棒性。理论与实证分析表明:FC分类器高敏感性带来强判别力,但易受攻击;ℓ₂分类器低敏感性保障鲁棒性,却限制性能。为此,我们提出基于混合原型混合(HPM)框架的新型ℓ₂重分类器,保留FC分类器的判别能力,同时利用ℓ₂距离的鲁棒性。该方法通过融合两类原型生成预测:(1) 通过指数移动平均(EMA)更新的稳定数据集级原型;(2) 基于FC分类器输出、使用直通估计器(STE)生成的动态批次级原型。然而,这种基于STE的动态架构带来梯度混淆与前向不连续等评估挑战。为此,我们设计新的严格评估协议——混合代理攻击(MSA),结合多种代理模型与强大AutoAttack,确保评估公平且可靠。大量实验表明,本轻量级、即插即用模块在极少微调下,有效增强多种现有SOTA对抗训练模型的鲁棒性。

原文摘要 · Abstract (English)

Modern neural networks are highly susceptible to adversarial perturbations. In this work, we identify that part of this vulnerability stems from the sensitivity of the widely used fully connected (FC) classifiers to such perturbations. In contrast, simple $\ell_2$ distance-based classifiers exhibit significantly greater robustness. We provide thorough theoretical and empirical analysis showing that while FC classifiers' high sensitivity makes them discriminative, it also makes them vulnerable. Conversely, $\ell_2$-classifiers' insensitivity grants robustness but limits performance. Motivated by this trade-off, we propose a novel $\ell_2$-reclassifier based on a Hybrid Prototype Mixing (HPM) framework. This method retains the discriminative power of FC classifiers while leveraging the robustness of $\ell_2$ distance. It yields $\ell_2$-distance-based predictions by fusing two prototype types: (1) stable, dataset-level prototypes updated via EMA, and (2) dynamic, batch-level prototypes generated from the FC classifier's predictions using a Straight-Through Estimator (STE). However, this dynamic, STE-based architecture introduces significant challenges for evaluation, such as gradient obfuscation and forward discontinuity. To address this, we propose a new, rigorous evaluation protocol, the Mixed Surrogate Attack (MSA), which uses multiple surrogates along with powerful AutoAttack to ensure a fair and robust assessment. Extensive experiments demonstrate that our lightweight, plug-and-play module, with minimal fine-tuning, effectively enhances the adversarial robustness of various existing SOTA adversarially trained models.

对抗鲁棒性原型学习分类器设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。