arXiv:2412.05934cs.CRcs.AI2024-12ICCV被引 33

通过多模态分散风险,实现对大模型的高效越狱攻击

Heuristic-Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models

  • 将恶意语义分散到多个模态,绕过单模态防护机制
  • 在7个开源模型上平均攻击成功率90%,3个闭源模型约68%
  • 适合研究模型安全与对抗攻击的学者参考

随着多模态大语言模型(MLLMs)的快速发展,其安全性问题日益受到学术界和产业界的关注。尽管MLLMs易受越狱攻击,但在真实部署场景中,攻击者面临高度受限的对抗能力,设计有效越狱攻击仍具挑战性。以往方法将风险集中于单一模态,导致攻击效果有限。本文提出一种黑盒越狱攻击方法HIMRD,包含两个核心:多模态风险分布策略与启发式搜索策略。前者将有害语义分发至多个模态,以规避MLLMs的单模态防护;后者识别两类提示:增强理解提示可帮助模型重构恶意指令,诱导提示则提高肯定回应概率,从而成功越狱。HIMRD在7个开源MLLM上平均攻击成功率(ASR)达90%,在3个闭源模型上平均约68%。该方法揭示了当前MLLMs存在的跨模态安全漏洞,强调亟需开发防御策略应对此类新兴风险。代码已公开于https://github.com/MaTengSYSU/HIMRD-jailbreak。

原文摘要 · Abstract (English)

With the rapid advancement of multimodal large language models (MLLMs), concerns regarding their security have increasingly captured the attention of both academia and industry. Although MLLMs are vulnerable to jailbreak attacks, designing effective jailbreak attacks poses unique challenges, especially given the highly constrained adversarial capabilities in real-world deployment scenarios. Previous works concentrate risks into a single modality, resulting in limited jailbreak performance. In this paper, we propose a heuristic-induced multimodal risk distribution jailbreak attack method, called HIMRD, which is black-box and consists of two elements: multimodal risk distribution strategy and heuristic-induced search strategy. The multimodal risk distribution strategy is used to distribute harmful semantics into multiple modalities to effectively circumvent the single-modality protection mechanisms of MLLMs. The heuristic-induced search strategy identifies two types of prompts: the understanding-enhancing prompt, which helps MLLMs reconstruct the malicious prompt, and the inducing prompt, which increases the likelihood of affirmative outputs over refusals, enabling a successful jailbreak attack. HIMRD achieves an average attack success rate (ASR) of 90% across seven open-source MLLMs and an average ASR of around 68% in three closed-source MLLMs. HIMRD reveals cross-modal security vulnerabilities in current MLLMs and underscores the imperative for developing defensive strategies to mitigate such emerging risks. Code is available at https://github.com/MaTengSYSU/HIMRD-jailbreak.

越狱攻击多模态安全漏洞对抗样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。