根据大模型理解能力自适应设计攻击策略,突破对齐防护
AJF: Adaptive Jailbreak Framework Based on the Comprehension Ability of Black-Box Large Language Models
- 按目标模型理解能力分型,分别采用双层加密或双向加密策略
- 对GPT-4o和GPT-4.1攻击成功率分别达98.9%和99.8%
- 揭示大模型对齐机制的深层漏洞,适合安全研究者参考
近期对抗性越狱攻击暴露出大型语言模型(LLMs)的关键漏洞,通过日益复杂的提示操纵绕过对齐防护。实验发现,越狱策略的有效性受目标LLM理解能力影响。基于此,我们提出一种基于黑盒大模型理解能力的自适应越狱框架(AJF)。首先对目标模型的理解能力进行分类,再采用相应策略:对理解能力有限的模型(类型I),采用分层语义变异与加密结合的MuEn策略,在输入和推理阶段更有效规避防御;对理解能力强的模型(类型II),在MuEn基础上增加诱导生成加密响应的环节,形成双向加密方案(MuDeEn),进一步突破输出阶段的防御。实验表明该方法效果显著,对GPT-4o(2025年5月29日发布版)攻击成功率达98.9%,对GPT-4.1(2025年7月8日发布版)达99.8%。本工作深化了对当前大模型对齐机制脆弱性的理解。
原文摘要 · Abstract (English)
Recent advancements in adversarial jailbreak attacks have exposed critical vulnerabilities in Large Language Models (LLMs), enabling the circumvention of alignment safeguards through increasingly sophisticated prompt manipulations. Our experiments find that the effectiveness of jailbreak strategies is influenced by the comprehension ability of the target LLM. Building on this insight, we propose an Adaptive Jailbreak Framework (AJF) based on the comprehension ability of black-box large language models. Specifically, AJF first categorizes the comprehension ability of the LLM and then applies different strategies accordingly: For models with limited comprehension ability (Type-I LLMs), AJF integrates layered semantic mutations with an encryption technique (MuEn strategy), to more effectively evade the LLM's defenses during the input and inference stages. For models with strong comprehension ability (Type-II LLMs), AJF employs a more complex strategy that builds upon the MuEn strategy by adding an additional layer: inducing the LLM to generate an encrypted response. This forms a dual-end encryption scheme (MuDeEn strategy), further bypassing the LLM's defenses during the output stage. Experimental results demonstrate the effectiveness of our approach, achieving attack success rates of \textbf{98.9\%} on GPT-4o (29 May 2025 release) and \textbf{99.8\%} on GPT-4.1 (8 July 2025 release). Our work contributes to a deeper understanding of the vulnerabilities in current LLMs alignment mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。