arXiv:2505.17598cs.CRcs.CL2025-05ICLR被引 15

提出可通用迁移的鲁棒越狱提示生成方法,有效突破多种防御机制。

One Model Transfer to All: On Robust Jailbreak Prompts Generation against LLMs

  • 基于通用鲁棒性评估模型,自动生成可绕过防御的越狱提示。
  • 在GPT-4和Claude-3上均实现显著超越现有攻击方法的效果。
  • 适用于白盒与黑盒场景,为安全研究提供新视角。

大型语言模型(LLMs)的安全对齐正面临越狱攻击的威胁,这类攻击可诱导模型生成有害或非预期内容。然而,许多现有越狱策略难以跟上防御机制(如防御后缀)的快速演进,导致对防御模型失效。为此,我们提出一种新型攻击方法ArrAttack,专为对抗防御型LLM设计。ArrAttack能自动生成可抵御多种防御措施的鲁棒越狱提示。该能力依托一个通用鲁棒性判断模型,该模型训练完成后可对任意目标模型及多样防御策略进行鲁棒性评估。借助此模型,可快速构建高效越狱提示生成器,将恶意输入转化为有效攻击。大量实验表明,ArrAttack在白盒与黑盒场景下均显著优于现有攻击策略,具备跨模型强迁移能力,涵盖GPT-4与Claude-3。本工作弥合了越狱攻击与防御之间的差距,为生成鲁棒越狱提示提供了新思路。代码已开源:https://github.com/LLBao/ArrAttack。

原文摘要 · Abstract (English)

Safety alignment in large language models (LLMs) is increasingly compromised by jailbreak attacks, which can manipulate these models to generate harmful or unintended content. Investigating these attacks is crucial for uncovering model vulnerabilities. However, many existing jailbreak strategies fail to keep pace with the rapid development of defense mechanisms, such as defensive suffixes, rendering them ineffective against defended models. To tackle this issue, we introduce a novel attack method called ArrAttack, specifically designed to target defended LLMs. ArrAttack automatically generates robust jailbreak prompts capable of bypassing various defense measures. This capability is supported by a universal robustness judgment model that, once trained, can perform robustness evaluation for any target model with a wide variety of defenses. By leveraging this model, we can rapidly develop a robust jailbreak prompt generator that efficiently converts malicious input prompts into effective attacks. Extensive evaluations reveal that ArrAttack significantly outperforms existing attack strategies, demonstrating strong transferability across both white-box and black-box models, including GPT-4 and Claude-3. Our work bridges the gap between jailbreak attacks and defenses, providing a fresh perspective on generating robust jailbreak prompts. We make the codebase available at https://github.com/LLBao/ArrAttack.

越狱攻击大模型安全鲁棒性提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。