arXiv:2507.02844cs.CVcs.CL2025-07EMNLP被引 28

用图像构建真实对话场景,突破多模态大模型安全防护

Visual Contextual Attack: Jailbreaking MLLMs with Image-Driven Context Injection

  • 以图像为主构建完整攻击上下文,而非仅作触发信号
  • 对GPT-4o攻击成功率85%,毒性评分4.78,显著优于基线
  • 适合研究模型安全、对抗攻击的学者与工程师参考

随着多模态大语言模型(MLLMs)视觉语言能力的提升,其在真实场景中展现出巨大潜力。然而,视觉模态暴露的安全漏洞给开放环境部署带来挑战。现有方法通过在视觉输入中直接嵌入有害文本语义来诱导模型产生不当响应,但此类方法多将视觉作为触发器,语义模糊且缺乏现实情境支撑。本文提出新的视觉主导型越狱设定:视觉信息是构建完整且真实攻击上下文的必要成分。基于此,我们设计了VisCo(Visual Contextual)攻击方法,采用四种聚焦视觉的策略生成上下文对话,并在必要时动态合成辅助图像,构建视觉主导的越狱场景。为增强攻击效果,引入自动毒性隐藏与语义优化机制,生成最终攻击提示。在MM-SafetyBench测试中,对GPT-4o的攻击成功率达85%,毒性评分为4.78,显著优于基线(ASR 22.2%,毒性2.48)。代码已开源。

原文摘要 · Abstract (English)

With the emergence of strong vision language capabilities, multimodal large language models (MLLMs) have demonstrated tremendous potential for real-world applications. However, the security vulnerabilities exhibited by the visual modality pose significant challenges to deploying such models in open-world environments. Recent studies have successfully induced harmful responses from target MLLMs by encoding harmful textual semantics directly into visual inputs. However, in these approaches, the visual modality primarily serves as a trigger for unsafe behavior, often exhibiting semantic ambiguity and lacking grounding in realistic scenarios. In this work, we define a novel setting: vision-centric jailbreak, where visual information serves as a necessary component in constructing a complete and realistic jailbreak context. Building on this setting, we propose the VisCo (Visual Contextual) Attack. VisCo fabricates contextual dialogue using four distinct vision-focused strategies, dynamically generating auxiliary images when necessary to construct a vision-centric jailbreak scenario. To maximize attack effectiveness, it incorporates automatic toxicity obfuscation and semantic refinement to produce a final attack prompt that reliably triggers harmful responses from the target black-box MLLMs. Specifically, VisCo achieves a toxicity score of 4.78 and an Attack Success Rate (ASR) of 85% on MM-SafetyBench against GPT-4o, significantly outperforming the baseline, which achieves a toxicity score of 2.48 and an ASR of 22.2%. Code: https://github.com/Dtc7w3PQ/Visco-Attack.

多模态安全越狱攻击视觉上下文LLM防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。