arXiv:2605.02647cs.CLcs.CR2026-05被引 1

通过模拟对话诱导,用进化搜索发现能绕过大模型安全机制的高危攻击。

ContextualJailbreak: Evolutionary Red-Teaming via Simulated Conversational Priming

论文配图:ContextualJailbreak: Evolutionary Red-Teaming via Simulated Conversational Priming
图 1 · 摘自论文原文
  • 在模拟多轮对话中演化攻击提示,利用分级伤害评分引导搜索。
  • 对多个主流模型实现100%攻击成功率,部分攻击可跨模型迁移。
  • 揭示不同厂商模型在安全防护上的显著差异,适合安全研究人员参考。

大型语言模型仍易受越狱攻击,此类攻击可绕过安全对齐机制并诱导有害回复。已有研究表明,上下文提示(即早期对话内容隐性影响后续回复)构成强大攻击面,精心设计的多轮提示框架在高性能模型上持续优于单轮操作。然而,现有基于优化的红队测试仍主要局限于单轮场景,难以动态推理何种对话提示模式能诱发模型服从。尽管近期出现部分多轮搜索方法,但有效提示对话的变异策略空间仍未被充分探索。本文提出 ContextualJailbreak,一种黑箱红队策略,通过在模拟多轮提示对话中执行进化搜索,并利用两级评判器提供的0-5分伤害评分作为循环反馈信号,使部分有害回复也能参与指导搜索过程。搜索过程采用五种语义定义的变异算子:角色扮演、情境设定、扩展、故障排查和机制构建,其中后两者为本文新贡献。在50个代表性 HarmBench 行为上,该方法在 gpt-oss:20B、qwen3-8B、llama3.1:70B 上均实现100%攻击成功率,在 gpt-oss:120B 上达90%,平均超越四类基线方法31-96个百分点。针对 gpt-oss:120B 发现的40个最致命攻击无需调整即可迁移至封闭前沿模型,分别在 gpt-4o-mini 达90.0%、gpt-5 和 gemini-3-flash 达70.0%,但在 claude-opus-4-7 和 claude-sonnet-4-6 上仅分别达17.5%与15.0%,凸显出模型提供方间显著的安全鲁棒性差异。

原文摘要 · Abstract (English)

Large language models (LLMs) remain vulnerable to jailbreak attacks that bypass safety alignment and elicit harmful responses. A growing body of work shows that contextual priming, where earlier turns covertly bias later replies, constitutes a powerful attack surface, with hand-crafted multi-turn scaffolds consistently outperforming single-turn manipulations on capable models. However, automated optimization-based red-teaming has remained largely limited to the single-turn setting, iterating over static prompts and lacking the ability to reason about which forms of conversational priming induce compliance. While recent multi-turn, search-based approaches have begun to bridge this gap, the mutator design space underlying effective primed dialogues remains largely unexplored. We present ContextualJailbreak, a black-box red-teaming strategy that performs evolutionary search over a simulated multi-turn primed dialogue. The strategy leverages a graded 0-5 harm score from a two-level judge as an in-loop signal, enabling partially harmful responses to guide the search process rather than being discarded. Search is driven by five semantically defined mutation operators: roleplay, scenario, expand, troubleshooting, and mechanistic, of which the last two are novel contributions of this work. Across 50 representative HarmBench behaviors, ContextualJailbreak achieves an ASR of 100% on gpt-oss:20B, 100% on qwen3-8B, 100% on llama3.1:70B, and 90% on gpt-oss:120B, outperforming four single- and multi-turn baselines by 31-96 percentage points on average. The 40 maximally harmful attacks discovered against gpt-oss:120B transfer without adaptation to closed frontier models, achieving 90.0% on gpt-4o-mini, 70.0% on gpt-5, and 70.0% on gemini-3-flash, but only 17.5% on claude-opus-4-7 and 15.0% on claude-sonnet-4-6, revealing a pronounced provider-level asymmetry in alignment robustness.

越狱攻击红队测试模型安全进化搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。