模型自己想办法绕过安全限制,用最少调用实现高成功率攻击。
Break Me If You Can: Self-Jailbreaking of Aligned LLMs via Lexical Insertion Prompting
- 利用目标模型自身知识,通过词序插入逐步生成越狱提示。
- 在11个模型上平均攻击成功率94.7%,平均仅需7.9次调用。
- 适合研究模型安全与防御机制的人员关注。
我们提出自越狱(self-jailbreaking)威胁模型,即对齐大模型自主引导自身被攻破。不同于依赖人工提示或外部攻击模型的常见方法,该方法无需外部红队模型,仅靠目标模型内部知识即可实现。我们设计了自越狱词序插入法(SLIP),一种黑盒算法,将越狱过程建模为多轮对话的广度优先树搜索,利用目标模型自身作为引导,逐步向良性提示中插入攻击目标所需的缺失词汇。在AdvBench和HarmBench上的测试表明,SLIP在11个被测模型(包括GPT-5.1、Claude-Sonnet-4.5、Gemini-2.5-Pro、DeepSeek-V3)上实现了90%–100%的攻击成功率(平均94.7%),平均仅需约7.9次大模型调用,比先前方法减少3–6倍。我们评估了现有防御措施,发现基于正则的方案可被提示改写绕过,并提出语义漂移监测器(SDM),通过追踪嵌入空间轨迹,在5%假阳性率下实现76%检测率。然而,面对自适应攻击策略,该防御仍显不足,凸显针对此类威胁设计更先进防御机制的必要性。代码已开源供复现。
原文摘要 · Abstract (English)
We introduce \emph{self-jailbreaking}, a threat model in which an aligned LLM guides its own compromise. Unlike most jailbreak techniques, which often rely on handcrafted prompts or separate attacker models, self-jailbreaking requires no external red-team LLM: the target model's own internal knowledge suffices. We operationalize this via \textbf{Self-Jailbreaking via Lexical Insertion Prompting (\textsc{SLIP})}, a black-box algorithm that casts jailbreaking as breadth-first tree search over multi-turn dialogues, incrementally inserting missing content words from the attack goal into benign prompts using the target model as its own guide. Evaluations on AdvBench and HarmBench show \textsc{SLIP} achieves 90--100\% Attack Success Rate (ASR) (avg.\ 94.7\%) across most of the eleven tested models (including GPT-5.1, Claude-Sonnet-4.5, Gemini-2.5-Pro, and DeepSeek-V3), with only ${\sim}7.9$ LLM calls on average, 3--6$\times$ fewer than prior methods. We evaluate existing defenses, show that regex-based approaches are evaded by prompt paraphrasing, and propose the Semantic Drift Monitor (SDM) defense that tracks \textsc{SLIP}'s embedding-space trajectory, achieving 76\% detection at 5\% FPR. However, SDM remains insufficient against adaptive attack strategies, underscoring the need for more advanced defense mechanisms tailored to the self-jailbreaking threat surface. We release our code for reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。