arXiv:2511.01375cs.AI2025-11被引 4

用双层优化自动生成更难防范的越狱攻击,提升安全测试效果。

Align to Misalign: Automatic LLM Jailbreak with Meta-Optimized LLM Judges

  • 通过双层结构同时优化越狱提示和评分模板,提升攻击效率。
  • 在Claude-3.5-Haiku上实现88.0%成功率,在Claude-4-Sonnet上达100%。
  • 无需人工设计评分标准,减少主观偏差,适合模型安全评估者使用。

识别大语言模型(LLMs)的漏洞对提升其安全性至关重要。越狱攻击通过精心设计的输入提示绕过安全防护,是红队测试中探测模型不当行为的核心手段。现有基于优化的越狱方法依赖稀疏的二元成功信号或人工设计的评分模板,易引入人为偏差与不确定性。为此,我们提出AMIS(Align to MISalign)框架,采用双层结构联合优化越狱提示与评分模板:内层利用固定模板提供细粒度反馈迭代优化提示;外层通过攻击成功率(ASR)对齐得分动态调整模板,使其更真实反映攻击效果。该协同优化过程逐步生成更强的越狱提示与更校准的评分信号。在AdvBench和JBB-Behaviors数据集上的评估表明,AMIS达到领先性能,包括在Claude-3.5-Haiku上实现88.0%的ASR,以及在Claude-4-Sonnet上实现100.0%的ASR,显著优于现有基线。

原文摘要 · Abstract (English)

Identifying the vulnerabilities of large language models (LLMs) is crucial for improving their safety by addressing inherent weaknesses. Jailbreaks, in which adversaries bypass safeguards with crafted input prompts, play a central role in red-teaming by probing LLMs to elicit unintended or unsafe behaviors. Recent optimization-based jailbreak approaches iteratively refine attack prompts by leveraging LLMs. However, they often rely heavily on either binary attack success rate (ASR) signals, which are sparse, or manually crafted scoring templates, which introduce human bias and uncertainty in the scoring outcomes. To address these limitations, we introduce AMIS (Align to MISalign), a meta-optimization framework that jointly evolves jailbreak prompts and scoring templates through a bi-level structure. In the inner loop, prompts are refined using fine-grained and dense feedback from a fixed scoring template. In the outer loop, the template is optimized using an ASR alignment score, gradually evolving to better reflect true attack outcomes across queries. This co-optimization process yields progressively stronger jailbreak prompts and more calibrated scoring signals. Evaluations on AdvBench and JBB-Behaviors demonstrate that AMIS achieves state-of-the-art performance, including 88.0% ASR on Claude-3.5-Haiku and 100.0% ASR on Claude-4-Sonnet, outperforming existing baselines by substantial margins.

越狱攻击模型安全双层优化自动评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。