提出GPO-V框架,破解扩散型多模态模型的安全防护
GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimization

- 通过全局概率优化操控扩散过程,突破传统提示注入攻击
- 在多个dVLM模型上实现90%以上成功率,且扰动隐蔽性强
- 适合安全研究者与模型开发者关注,警示非序列生成架构风险
基于扩散模型的视觉语言模型(dVLMs)虽摆脱了传统自回归生成范式,在多模态任务中表现优异,但其对常规越狱攻击(如固定前缀优化FPO)看似具备鲁棒性,实则存在隐性漏洞。我们发现dVLMs存在‘立即拒绝’与‘渐进拒绝’两种独特拒绝模式,其中渐进优化过程暴露了新的潜在攻击面。为此,我们提出全局概率优化(GPO),一种专为掩码扩散模型去噪轨迹设计的越狱范式,不依赖前缀注入,而是操控整体生成动态以绕过安全护栏。基于此,我们构建了首个针对dVLM的视觉模态越狱框架GPO-V。实验表明,GPO-V可生成高度隐蔽的扰动,在跨模型迁移中成功率超90%,揭示了非序列生成架构中的关键安全缺口。该研究亟需重新评估现有防御机制,以应对扩散模型特有的生成风险。代码已公开于https://anonymous.4open.science/r/GPO-V-0250。
原文摘要 · Abstract (English)
Diffusion Vision-Language Models (dVLMs), built upon the non-causal foundations of Diffusion Large Language Models (dLLMs), have demonstrated remarkable efficacy in multimodal tasks by departing from the traditional autoregressive generation paradigm. While dVLMs appear inherently robust against conventional jailbreak tactics, which we categorize as Fixed Prefix Optimization (FPO) (e.g., anchoring responses with "Sure, here is"), this perceived resilience is deceptive. Our investigation into the safety landscape of dVLMs reveals a unique refusal pattern: Immediate Refusal and Progressive Refusal. We find that while FPO-based attacks often fail by triggering the latter, the progressive refinement process itself uncovers a novel, latent attack surface. To exploit this vulnerability, we propose Global Probability Optimization (GPO), a general jailbreak paradigm designed specifically for the denoising trajectory of masked diffusion models. Unlike prefix-based methods, GPO manipulates the global generative dynamics to bypass guardrails in diffusion language models. Building on this, we introduce GPO-V, the first visual-modality jailbreak framework tailored for dVLMs. Empirical results demonstrate that GPO-V produces stealthy perturbations with exceptional cross-model transferability, revealing a critical security gap in non-sequential generative architectures. Our findings underscore the critical urgency of addressing safety alignment in dVLMs. These results necessitate an immediate and fundamental re-evaluation of current defense paradigms to mitigate the unique risks of diffusion-based generation. Our code is available at: https://anonymous.4open.science/r/GPO-V-0250.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。