arXiv:2510.12752cs.LG2025-10

不改模型结构,用两种相似度检测对抗样本,精度超90%。

KoALA: KL-L0 Adversarial Detector via Label Agreement

  • 通过KL散度与L0相似度互补判断是否被攻击
  • 在CIFAR-10上召回率达97%,精度达96%
  • 无需重训练,适配现有模型和多种数据类型

深度神经网络极易受到对抗攻击,威胁安全关键应用。我们提出KoALA(KL-L0对抗检测器),一种无需架构修改或对抗重训练的语义无关检测方法。其核心原理是:当两个互补的相似度度量(KL散度与基于L0的相似度)产生的分类预测不一致时,判定为对抗攻击。前者对密集低幅扰动敏感,后者针对稀疏高影响变化。我们提供了理论正确性证明。唯一训练步骤是在预训练图像编码器上用干净图像进行微调,以确保嵌入同时契合两种度量。该方法轻量、即插即用,适用于多种模型和数据模态。在ResNet/CIFAR-10和CLIP/Tiny-ImageNet上的大量实验验证了理论结论。当满足定理条件时,KoALA持续有效检测对抗样本。在完整测试集上,ResNet/CIFAR-10的精度为0.96、召回率为0.97;CLIP/Tiny-ImageNet的精度为0.71、召回率为0.94。

原文摘要 · Abstract (English)

Deep neural networks are highly susceptible to adversarial attacks, which pose significant risks to security- and safety-critical applications. We present KoALA (KL-L0 Adversarial detection via Label Agreement), a novel, semantics-free adversarial detector that requires no architectural changes or adversarial retraining. KoALA operates on a simple principle: it detects an adversarial attack when class predictions from two complementary similarity metrics disagree. These metrics - KL divergence and an L0-based similarity - are specifically chosen to detect different types of perturbations. The KL divergence metric is sensitive to dense, low-amplitude shifts, while the L0-based similarity is designed for sparse, high-impact changes. We provide a formal proof of correctness for our approach. The only training required is a simple fine-tuning step on a pre-trained image encoder using clean images to ensure the embeddings align well with both metrics. This makes KoALA a lightweight, plug-and-play solution for existing models and various data modalities. Our extensive experiments on ResNet/CIFAR-10 and CLIP/Tiny-ImageNet confirm our theoretical claims. When the theorem's conditions are met, KoALA consistently and effectively detects adversarial examples. On the full test sets, KoALA achieves a precision of 0.96 and a recall of 0.97 on ResNet/CIFAR-10, and a precision of 0.71 and a recall of 0.94 on CLIP/Tiny-ImageNet.

对抗检测无监督轻量检测多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。