arXiv:2608.27531cs.CRcs.CV2026-08中稿 · EMNLP

让攻击者自我进化,突破视觉语言模型安全防线

Fully Unleashing the Multimodal Attacker: Meta-Adaptive Jailbreaking of Vision-Language Models

论文配图:Fully Unleashing the Multimodal Attacker: Meta-Adaptive Jailbreaking of Vision-Language Models
图 1 · 摘自论文原文
  • 攻击者自身动态优化策略与参数,实现元级自适应
  • 在多模态安全基准上对三款主流模型攻击成功率超80%
  • 攻击效果可迁移且能绕过典型防御,适合研究安全漏洞者

大型视觉语言模型的安全性正面临多模态越狱攻击的严峻考验。现有攻击大多停留在静态元层级:模板类攻击固定图像-文本布局,迭代类攻击仅调整内容但策略和参数固定。本文提出元自适应多模态越狱(MAMJ),通过优化攻击者自身两个维度:控制攻击迭代的攻击策略提示(ASP)θ,以及决定攻击效果的攻击者权重ϕ。在多模态攻击轨迹群体中,基于LLM的评估首先优化θ,随后根据群体平均攻击成功率(ASR)奖励更新ϕ。在MM-SafetyBench测试中,MAMJ对GPT-4o、Gemini-3-Pro-Preview和Seed 2.0的攻击成功率分别达81.0%、78.9%和82.3%,较最强样本级基线最高提升24.1个百分点。所学习的攻击者(θ⋆,ϕ⋆)无需重训练即可迁移至未见目标,且在典型防御下仍有效。结果揭示前沿视觉语言模型对元自适应攻击存在系统性脆弱,呼吁针对元层级对手的防御机制。代码已开源。

原文摘要 · Abstract (English)

The safety of large vision-language models is increasingly stress-tested by multimodal jailbreaks, yet existing attacks remain largely static at the meta level: template-based attacks freeze the image--text layout, while iterative attacks adapt only the image--text content with fixed attack strategies and frozen attacker parameters. We propose Meta-Adaptive Multimodal Jailbreaking (MAMJ), which instead optimizes the attacker itself along two axes: an attack strategy prompt (ASP) $θ$ governing attack iteration and attacker weights $ϕ$ determining attack effectiveness. Across groups of multimodal attack trajectories, an LLM-based critique first refines $θ$, after which group-aggregated attack-success-rate (ASR) rewards update $ϕ$. On MM-SafetyBench, MAMJ achieves $81.0\%$, $78.9\%$, and $82.3\%$ ASR against GPT-4o, Gemini-3-Pro-Preview, and Seed 2.0, respectively, outperforming the strongest sample-level baseline by up to $24.1$ percentage points. The learned attacker $(θ^\star,ϕ^\star)$ also transfers without retraining to unseen victims and remains effective under representative defenses. These results reveal a systemic vulnerability of frontier VLMs to meta-adaptive jailbreaks and motivate defenses against meta-level adversaries. Code is available at https://github.com/Alibaba-VELLDEPTH/MetaJailbreak-VLM.

多模态攻击越狱防御自适应攻击视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。