arXiv:2602.06854cs.CL2026-02被引 12

提出简单有效的多轮越狱攻击框架,无需外部数据即可生成高成功率攻击。

SEMA: Simple yet Effective Learning for Multi-Turn Jailbreak Attacks

  • 自动生成多轮对抗提示并微调,稳定学习过程
  • 80.1%平均攻击成功率,超越现有所有方法
  • 适合用于测试大模型安全性和自动红队测试

多轮越狱攻击更贴近真实安全威胁场景,但现有方法受限于探索复杂度和意图漂移。本文提出SEMA框架,通过两阶段训练实现无需依赖外部数据或已有策略的多轮攻击。第一阶段“预填充自调优”利用最小前缀自动生成非拒绝、结构良好的多轮对抗提示并微调,提升后续学习稳定性;第二阶段采用意图漂移感知奖励的强化学习,持续保持有害目标的同时生成有效攻击。该框架基于开环攻击机制,避免对目标反馈依赖,统一单轮与多轮设置,降低探索复杂度。在多个数据集、目标模型和越狱评测中,SEMA达到当前最优攻击成功率(ASR),例如在AdvBench上对三个开源与闭源模型平均达成80.1%的ASR@1,比先前最先进方法高出33.9%。该方法简洁可复现,具备跨目标迁移能力,为大模型安全提供更强现实压力测试,并支持自动化红队检测缺陷模式。代码已公开。

原文摘要 · Abstract (English)

Multi-turn jailbreaks capture the real threat model for safety-aligned chatbots, where single-turn attacks are merely a special case. Yet existing approaches break under exploration complexity and intent drift. We propose SEMA, a simple yet effective framework that trains a multi-turn attacker without relying on any existing strategies or external data. SEMA comprises two stages. Prefilling self-tuning enables usable rollouts by fine-tuning on non-refusal, well-structured, multi-turn adversarial prompts that are self-generated with a minimal prefix, thereby stabilizing subsequent learning. Reinforcement learning with intent-drift-aware reward trains the attacker to elicit valid multi-turn adversarial prompts while maintaining the same harmful objective. We anchor harmful intent in multi-turn jailbreaks via an intent-drift-aware reward that combines intent alignment, compliance risk, and level of detail. Our open-loop attack regime avoids dependence on victim feedback, unifies single- and multi-turn settings, and reduces exploration complexity. Across multiple datasets, victim models, and jailbreak judges, our method achieves state-of-the-art (SOTA) attack success rates (ASR), outperforming all single-turn baselines, manually scripted and template-driven multi-turn baselines, as well as our SFT (Supervised Fine-Tuning) and DPO (Direct Preference Optimization) variants. For instance, SEMA performs an average 80.1% ASR@1 across three closed-source and open-source victim models on AdvBench, 33.9% over prior SOTA. The approach is compact, reproducible, and transfers across targets, providing a stronger and more realistic stress test for large language model (LLM) safety and enabling automatic redteaming to expose and localize failure modes. Our code is available at: https://github.com/microsoft/SEMA.

越狱攻击多轮对抗红队测试LLM安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。