arXiv:2503.09095cs.CRcs.CV2025-03被引 1

用概念混淆攻击CLIP,让模型看到特定概念就触发后门。

Backdooring CLIP through Concept Confusion

  • 以可解释的概念作为内部触发器,无需修改输入图像
  • 在不降低正常任务准确率下,实现超过90%的攻击成功率
  • 适合研究模型安全与对抗性概念注入的学者

后门攻击通过在训练数据中植入隐蔽行为,使模型在干净输入下表现正常,但在特定触发条件下产生恶意输出。现有方法多依赖显式触发器(如图像补丁或像素扰动),易被检测且适用性受限。本文从可解释AI的角度出发,发现传统攻击本质是隐式操控模型潜在空间中的概念激活。基于此,提出概念混淆攻击(CCA):将人类可理解的概念作为内部触发器,通过重标注包含目标概念的图像并微调,使模型将该概念与攻击者指定标签绑定。因此,仅需出现该概念即可激活后门,更具隐蔽性且能绕过主流防御。以CLIP为例,实验表明CCA在保持正常任务准确率的同时,攻击成功率超过90%,有效规避了当前最先进的防御机制。

原文摘要 · Abstract (English)

Backdoor attacks pose a serious threat to deep learning models by allowing adversaries to implant hidden behaviors that remain dormant on clean inputs but are maliciously triggered at inference. Existing backdoor attack methods typically rely on explicit triggers such as image patches or pixel perturbations, which makes them easier to detect and limits their applicability in complex settings. To address this limitation, we take a different perspective by analyzing backdoor attacks through the lens of concept-level reasoning, drawing on insights from interpretable AI. We show that traditional attacks can be viewed as implicitly manipulating the concepts activated within a model's latent space. This motivates a natural question: can backdoors be built by directly manipulating concepts? To answer this, we propose the Concept Confusion Attack (CCA), a novel framework that designates human-understandable concepts as internal triggers, eliminating the need for explicit input modifications. By relabeling images that strongly exhibit a chosen concept and fine-tuning on this mixed dataset, CCA teaches the model to associate the concept itself with the attacker's target label. Consequently, the presence of the concept alone is sufficient to activate the backdoor, making the attack stealthier and more resistant to existing defenses. Using CLIP as a case study, we show that CCA achieves high attack success rates while preserving clean-task accuracy and evading state-of-the-art defenses.

后门攻击概念混淆CLIP模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。