用学习方法模拟真人多轮越狱攻击,成功率超90%。
Siren: A Learning-Based Multi-Turn Attack Framework for Simulating Real-World Human Jailbreak Behaviors
- 通过多轮反馈训练生成动态攻击策略
- 对Gemini-1.5-Pro攻击成功率达90%,优于单轮基线
- 7B模型性能媲美用GPT-4o的复杂方案
大型语言模型在实际应用中引发安全与可信度担忧。现有红队测试多聚焦单轮越狱提示,忽视真实攻击者使用的多轮策略。现有方法依赖静态模式或预设逻辑链,无法适应攻击过程中的动态变化。本文提出Siren,一种基于学习的多轮攻击框架,旨在模拟真实人类越狱行为。Siren包含三个阶段:(1) 利用逐轮大模型反馈构建最小最大对抗训练集;(2) 通过监督微调(SFT)与直接偏好优化(DPO)对攻击者进行后训练;(3) 攻击者与目标模型间的交互。实验表明,以LLaMA-3-8B为攻击者时,对Gemini-1.5-Pro的攻击成功率(ASR)达90%;以Mistral-7B为攻击者时,对GPT-4o的攻击成功率可达70%,显著优于单轮基线。此外,7B规模的Siren性能接近使用GPT-4o作为攻击者的多轮基准,但所需轮次更少,且采用语义更契合攻击目标的分解策略。代码已开源。警告:本文含潜在有害文本。
原文摘要 · Abstract (English)
Large language models (LLMs) are widely used in real-world applications, raising concerns about their safety and trustworthiness. While red-teaming with jailbreak prompts exposes the vulnerabilities of LLMs, current efforts focus primarily on single-turn attacks, overlooking the multi-turn strategies used by real-world adversaries. Existing multi-turn methods rely on static patterns or predefined logical chains, failing to account for the dynamic strategies during attacks. We propose Siren, a learning-based multi-turn attack framework designed to simulate real-world human jailbreak behaviors. Siren consists of three stages: (1) MiniMax-driven training set construction utilizing Turn-Level LLM feedback, (2) post-training attackers with supervised fine-tuning (SFT) and direct preference optimization (DPO), and (3) interactions between the attacking and target LLMs. Experiments demonstrate that Siren achieves an attack success rate (ASR) of 90% with LLaMA-3-8B as the attacker against Gemini-1.5-Pro as the target model, and 70% with Mistral-7B against GPT-4o, significantly outperforming single-turn baselines. Moreover, Siren with a 7B-scale model achieves performance comparable to a multi-turn baseline that leverages GPT-4o as the attacker, while requiring fewer turns and employing decomposition strategies that are better semantically aligned with attack goals. We hope Siren inspires the development of stronger defenses against advanced multi-turn jailbreak attacks under realistic scenarios. Code is available at https://github.com/YiyiyiZhao/siren. Warning: This paper contains potentially harmful text.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。