首次提出针对视觉语言模型的多目标后门攻击,威胁更大且更难防御。
MTAttack: Multi-Target Backdoor Attacks against Large Vision-Language Models
- 设计新型优化方法,让多个触发器在隐空间独立映射到不同目标类。
- 在多个基准上成功率显著高于现有方法,且跨数据集泛化能力强。
- 适用于研究模型安全性的研究人员,揭示大模型潜在风险。
大型视觉语言模型(LVLM)在图像-文本预训练和指令微调下表现出色,但其安全性问题日益突出,尤其易受后门攻击。现有攻击多为单目标,即针对特定触发器的单一恶意输出。本文首次揭示多目标后门攻击:在一次训练中引入多个独立触发器,对应不同攻击目标,威胁更大。由于不同触发器间特征干扰严重,实现准确的多触发器-目标映射极具挑战。为此,我们提出首个针对LVLM的多目标后门攻击框架MTAttack,核心是包含两个约束的优化方法——代理空间划分约束与触发器原型锚定约束。该方法在隐空间联合优化多个触发器,使每个触发器独立将干净图像映射至唯一代理类,同时保证其可区分性。实验表明,MTAttack在主流基准上成功率显著优于现有方法,且对多种数据集具有强泛化能力,对抗后门防御策略也表现鲁棒。结果凸显了LVLM在多目标攻击下的脆弱性,亟需加强防护。代码已开源:https://github.com/mala-lab/MTAttack。
原文摘要 · Abstract (English)
Recent advances in Large Visual Language Models (LVLMs) have demonstrated impressive performance across various vision-language tasks by leveraging large-scale image-text pretraining and instruction tuning. However, the security vulnerabilities of LVLMs have become increasingly concerning, particularly their susceptibility to backdoor attacks. Existing backdoor attacks focus on single-target attacks, i.e., targeting a single malicious output associated with a specific trigger. In this work, we uncover multi-target backdoor attacks, where multiple independent triggers corresponding to different attack targets are added in a single pass of training, posing a greater threat to LVLMs in real-world applications. Executing such attacks in LVLMs is challenging since there can be many incorrect trigger-target mappings due to severe feature interference among different triggers. To address this challenge, we propose MTAttack, the first multi-target backdoor attack framework for enforcing accurate multiple trigger-target mappings in LVLMs. The core of MTAttack is a novel optimization method with two constraints, namely Proxy Space Partitioning constraint and Trigger Prototype Anchoring constraint. It jointly optimizes multiple triggers in the latent space, with each trigger independently mapping clean images to a unique proxy class while at the same time guaranteeing their separability. Experiments on popular benchmarks demonstrate a high success rate of MTAttack for multi-target attacks, substantially outperforming existing attack methods. Furthermore, our attack exhibits strong generalizability across datasets and robustness against backdoor defense strategies. These findings highlight the vulnerability of LVLMs to multi-target backdoor attacks and underscore the urgent need for mitigating such threats. Code is available at https://github.com/mala-lab/MTAttack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。