arXiv:2504.00429cs.CV2025-04被引 1

用预训练模型检测各类对抗攻击,效果更好且更省力。

Unleashing the Power of Pre-trained Encoders for Universal Adversarial Attack Detection

  • 用CLIP双编码器+可学习提示词构建紧凑表征空间。
  • 对已知和未知攻击的泛化能力显著优于传统方法。
  • 轻量级设计,训练成本低,适合实际部署。

对抗攻击通过向正常样本注入人眼无法察觉的扰动,导致深度学习模型误分类,严重威胁真实AI系统的安全。现有检测方法如贝叶斯不确定性估计和激活模式分析虽有进展,但依赖手工特征设计和攻击先验知识,泛化能力差且工程成本高。本文提出一种基于大规模预训练视觉-语言模型CLIP的轻量级对抗检测框架。突破传统特征刻画范式,创新性地采用异常检测视角。通过联合微调CLIP的视觉与文本双编码器,并引入可训练适配器网络和可学习提示词,构建针对自然图像的紧凑表征空间。实验表明,该检测架构在已知和未知攻击模式下的泛化能力显著提升,同时大幅降低训练开销。本研究为建立参数高效、攻击无关的防御范式提供了新路径,显著增强视觉系统对演进中对抗威胁的鲁棒性。

原文摘要 · Abstract (English)

Adversarial attacks pose a critical security threat to real-world AI systems by injecting human-imperceptible perturbations into benign samples to induce misclassification in deep learning models. While existing detection methods, such as Bayesian uncertainty estimation and activation pattern analysis, have achieved progress through feature engineering, their reliance on handcrafted feature design and prior knowledge of attack patterns limits generalization capabilities and incurs high engineering costs. To address these limitations, this paper proposes a lightweight adversarial detection framework based on the large-scale pre-trained vision-language model CLIP. Departing from conventional adversarial feature characterization paradigms, we innovatively adopt an anomaly detection perspective. By jointly fine-tuning CLIP's dual visual-text encoders with trainable adapter networks and learnable prompts, we construct a compact representation space tailored for natural images. Notably, our detection architecture achieves substantial improvements in generalization capability across both known and unknown attack patterns compared to traditional methods, while significantly reducing training overhead. This study provides a novel technical pathway for establishing a parameter-efficient and attack-agnostic defense paradigm, markedly enhancing the robustness of vision systems against evolving adversarial threats.

对抗攻击CLIP异常检测轻量级

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。