arXiv:2605.21362cs.CL2026-05

通过自适应组合多种攻击策略,显著提升对大模型的越狱成功率。

LASH: Adaptive Semantic Hybridization for Black-Box Jailbreaking of Large Language Models

论文配图:LASH: Adaptive Semantic Hybridization for Black-Box Jailbreaking of Large Language Models
图 1 · 摘自论文原文
  • 将多种越狱方法生成的提示作为种子,动态混合优化。
  • 在10类有害请求上平均成功率达84.5%(关键词检测)和74.5%(双阶段评估)。
  • 仅需30次目标查询,适合黑盒红队测试与对抗防御研究。

越狱攻击揭示了对齐的大语言模型在安全行为上的理想与实际表现之间的持续差距。现有自动化方法虽日益有效,但每种方法仅针对单一攻击类型(如一种精炼循环、一种树搜索、一种变异空间或一种策略库),且无一种方法在所有场景下占优:最佳方法随目标模型和危害类别变化,表明不同方法具有互补优势,可通过逐请求组合加以利用。本文提出LASH(LLM自适应语义混合),一种黑盒框架,将多种基础攻击的输出视为可复用的种子提示,并为每个目标请求自适应地组合它们。给定种子池后,LASH在种子子集和软最大化混合权重间搜索;一个组合模块生成单个候选提示,基于无导数的遗传优化器,利用黑盒目标反馈和两阶段评分函数更新权重,该函数结合关键词拒绝检测与LLM裁判评分。在包含100个有害提示的JailbreakBench上,我们评估了六种常见目标模型的表现。LASH在关键词评估下达到84.5%的平均攻击成功率,在双阶段评估下为74.5%(先过滤拒绝响应,再由LLM裁判判断是否实质性满足原始有害请求)。相比五种最先进基线,LASH在两项指标上均表现更优,且仅需30次平均目标查询。在三种防御机制下仍具竞争力,并诱导出更具攻击性的内部表征。结果表明,跨异构越狱策略的自适应组合是黑盒红队测试的有前景方向。

原文摘要 · Abstract (English)

Jailbreak attacks expose a persistent gap between the intended safety behavior of aligned large language models and their behavior under adversarial prompting. Existing automated methods are increasingly effective but each commits to a single attack family (e.g., one refinement loop, one tree search, one mutation space, or one strategy library) and no single family dominates: the best-performing method shifts across target models and harm categories, suggesting complementary strengths that per-prompt composition could exploit. We introduce LASH (LLM Adaptive Semantic Hybridization), a black-box framework that treats outputs from multiple base attacks as reusable seed prompts and adaptively composes them for each target request. Given a seed pool, LASH searches over seed subsets and softmax-normalized mixture weights; a composition module synthesizes a single candidate prompt, and a derivative-free genetic optimizer updates the weights using black-box target feedback and a two-stage fitness function combining keyword-based refusal detection with LLM-judge scoring. On JailbreakBench, which contains 100 harmful prompts across 10 categories, we evaluate LASH on six common target models. LASH achieves an average attack success rate of 84.5% under keyword-based evaluation and 74.5% under two-stage evaluation, where responses are first filtered for refusals and then scored by an LLM judge for whether they substantively fulfill the original harmful request. LASH outperforms five state-of-the-art baselines on both metrics with only 30 mean target queries. LASH also remains competitive under three defense mechanisms and induces more success-like internal representations. These results suggest that adaptive composition across heterogeneous jailbreak strategies is a promising direction for black-box red-teaming.

越狱攻击黑盒测试LLM安全自适应组合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。