用自动生成的流程图诱导多模态大模型输出有害内容,成功率高达96%。
FC-Attack: Jailbreaking Multimodal Large Language Models via Auto-Generated Flowcharts
- 用良性数据微调语言模型生成步骤描述,再转为三种形状的流程图作为视觉诱饵。
- 在Advbench测试中,图像攻击成功率最高达96%,视频攻击达78%。
- 改变字体风格可将Claude-3.5的攻击成功率从4%提升至28%,适合安全研究者参考。
多模态大语言模型(MLLMs)在实际应用中日益普及,但其安全性面临挑战。尽管多数模型已进行安全对齐,视觉模态仍易受越狱攻击影响。本文发现,通过包含部分有害信息的流程图,可诱导MLLM生成更多有害内容。为此提出自动构建流程图的越狱攻击方法——FC-Attack:首先用良性数据微调预训练语言模型,生成对应恶意查询的步骤描述;再将其转化为垂直、水平和S形三种视觉样式流程图,与良性文本提示结合,实施越狱攻击。在Advbench评测中,该方法在图像输入下最高实现96%的攻击成功率,视频输入下达78%。我们还发现步骤数量和字体风格影响攻击效果,改变字体可使Claude-3.5的攻击成功率从4%提升至28%。为缓解此威胁,尝试多种防御策略,发现AdaShield虽能显著降低攻击成功率,但伴随性能下降。
原文摘要 · Abstract (English)
Multimodal Large Language Models (MLLMs) have become powerful and widely adopted in some practical applications. However, recent research has revealed their vulnerability to multimodal jailbreak attacks, whereby the model can be induced to generate harmful content, leading to safety risks. Although most MLLMs have undergone safety alignment, recent research shows that the visual modality is still vulnerable to jailbreak attacks. In our work, we discover that by using flowcharts with partially harmful information, MLLMs can be induced to provide additional harmful details. Based on this, we propose a jailbreak attack method based on auto-generated flowcharts, FC-Attack. Specifically, FC-Attack first fine-tunes a pre-trained LLM to create a step-description generator based on benign datasets. The generator is then used to produce step descriptions corresponding to a harmful query, which are transformed into flowcharts in 3 different shapes (vertical, horizontal, and S-shaped) as visual prompts. These flowcharts are then combined with a benign textual prompt to execute the jailbreak attack on MLLMs. Our evaluations on Advbench show that FC-Attack attains an attack success rate of up to 96% via images and up to 78% via videos across multiple MLLMs. Additionally, we investigate factors affecting the attack performance, including the number of steps and the font styles in the flowcharts. We also find that FC-Attack can improve the jailbreak performance from 4% to 28% in Claude-3.5 by changing the font style. To mitigate the attack, we explore several defenses and find that AdaShield can largely reduce the jailbreak performance but with the cost of utility drop.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。