发现扩散型大模型存在隐蔽安全漏洞,可被伪装提示攻破。
The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMs
- 设计新型攻击框架DIJA,利用双向建模与并行解码机制生成伪装提示。
- 在Dream-Instruct上实现100%关键词攻击成功率,超越基线78.5%。
- 无需隐藏恶意内容即可突破对齐防护,适合关注AI安全的研究者。
基于扩散的大型语言模型(dLLMs)作为自回归模型的有力替代,凭借并行解码和双向建模实现了更快推理与更高交互性。然而,尽管在代码生成和文本补全任务中表现优异,我们发现现有对齐机制无法有效防范上下文感知的掩码输入对抗性提示,暴露出新型安全隐患。为此,我们提出DIJA——首个系统性研究及越狱攻击框架,专门针对dLLMs的独特安全弱点。DIJA通过构建交错掩码-文本对抗提示,利用dLLMs的双向建模与并行解码机制:双向建模促使模型为掩码部分生成语境一致的输出,即使内容有害;并行解码则限制模型动态过滤与拒绝采样,导致标准对齐机制失效。实验表明,该方法显著优于现有越狱手段,在Dream-Instruct上实现高达100%的关键词攻击成功率(ASR),在JailbreakBench上较最强基线ReNeLLM提升78.5%(评测器评估),在StrongREJECT得分上高出37.7分,且无需重写或隐藏恶意内容。结果凸显亟需重新审视此类新兴模型的安全对齐策略。代码已开源:https://github.com/ZichenWen1/DIJA。
原文摘要 · Abstract (English)
Diffusion-based large language models (dLLMs) have recently emerged as a powerful alternative to autoregressive LLMs, offering faster inference and greater interactivity via parallel decoding and bidirectional modeling. However, despite strong performance in code generation and text infilling, we identify a fundamental safety concern: existing alignment mechanisms fail to safeguard dLLMs against context-aware, masked-input adversarial prompts, exposing novel vulnerabilities. To this end, we present DIJA, the first systematic study and jailbreak attack framework that exploits unique safety weaknesses of dLLMs. Specifically, our proposed DIJA constructs adversarial interleaved mask-text prompts that exploit the text generation mechanisms of dLLMs, i.e., bidirectional modeling and parallel decoding. Bidirectional modeling drives the model to produce contextually consistent outputs for masked spans, even when harmful, while parallel decoding limits model dynamic filtering and rejection sampling of unsafe content. This causes standard alignment mechanisms to fail, enabling harmful completions in alignment-tuned dLLMs, even when harmful behaviors or unsafe instructions are directly exposed in the prompt. Through comprehensive experiments, we demonstrate that DIJA significantly outperforms existing jailbreak methods, exposing a previously overlooked threat surface in dLLM architectures. Notably, our method achieves up to 100% keyword-based ASR on Dream-Instruct, surpassing the strongest prior baseline, ReNeLLM, by up to 78.5% in evaluator-based ASR on JailbreakBench and by 37.7 points in StrongREJECT score, while requiring no rewriting or hiding of harmful content in the jailbreak prompt. Our findings underscore the urgent need for rethinking safety alignment in this emerging class of language models. Code is available at https://github.com/ZichenWen1/DIJA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。