自动化生成多轮恶意提示,突破大模型安全限制。
AutoAdv: Automated Adversarial Prompting for Multi-Turn Jailbreaking of Large Language Models
- 用可调参数的攻击模型重写提示,伪装恶意内容
- 多轮迭代攻击,对失败尝试动态优化,最高86%成功率
- 适合研究模型安全或漏洞挖掘的开发者
大型语言模型仍易受越狱攻击:精心构造的恶意输入可绕过安全防护,诱导产生有害回复。本文提出AutoAdv框架,自动生成对抗性提示以系统评估并暴露大模型安全机制的漏洞。该方法利用参数化攻击模型,通过策略性重写、专用系统提示和优化超参数配置,生成语义隐蔽的恶意提示。核心贡献是动态多轮攻击方法,能分析失败尝试并迭代生成优化后的后续提示,采用角色扮演、误导和上下文操控等技术。我们基于StrongREJECT(arXiv:2402.10260 [cs.CL])框架,在多轮交互中量化攻击成功率(ASR)。对ChatGPT、Llama、DeepSeek等前沿模型的广泛实证表明,当前安全机制仍易受复杂多轮攻击,自动化攻击最高实现86%的越狱成功率,凸显亟需更强的防御策略。
原文摘要 · Abstract (English)
Large Language Models (LLMs) continue to exhibit vulnerabilities to jailbreaking attacks: carefully crafted malicious inputs intended to circumvent safety guardrails and elicit harmful responses. As such, we present AutoAdv, a novel framework that automates adversarial prompt generation to systematically evaluate and expose vulnerabilities in LLM safety mechanisms. Our approach leverages a parametric attacker LLM to produce semantically disguised malicious prompts through strategic rewriting techniques, specialized system prompts, and optimized hyperparameter configurations. The primary contribution of our work is a dynamic, multi-turn attack methodology that analyzes failed jailbreak attempts and iteratively generates refined follow-up prompts, leveraging techniques such as roleplaying, misdirection, and contextual manipulation. We quantitatively evaluate attack success rate (ASR) using the StrongREJECT (arXiv:2402.10260 [cs.CL]) framework across sequential interaction turns. Through extensive empirical evaluation of state-of-the-art models--including ChatGPT, Llama, and DeepSeek--we reveal significant vulnerabilities, with our automated attacks achieving jailbreak success rates of up to 86% for harmful content generation. Our findings reveal that current safety mechanisms remain susceptible to sophisticated multi-turn attacks, emphasizing the urgent need for more robust defense strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。