arXiv:2604.24983cs.AI2026-04

不加恶意后缀,直接优化提示词嵌入实现更隐蔽的越狱攻击

Adaptive Prompt Embedding Optimization for LLM Jailbreaking

  • 在嵌入空间直接优化原始提示词,不添加任何额外标记
  • 保持原提示不变形,仍能通过基准测试达成90%以上越狱成功率
  • 适合研究模型安全与对抗样本防御的研究者

现有白盒越狱攻击通常在用户提示后追加离散的对抗性后缀,会明显改变提示内容并在组合的令牌空间中运行。以往工作避免直接优化原始提示令牌的嵌入,认为可能破坏语义。本文提出提示嵌入优化(PEO),一种多轮白盒越狱方法,直接优化原始提示令牌的嵌入,不附加任何对抗性令牌。实验表明该顾虑不成立:优化后的嵌入经最近令牌投影后,提示字符串与原样完全一致;定量分析显示,模型响应在绝大多数情况下仍紧扣主题。PEO结合连续嵌入空间优化、结构化延续目标和自适应失败聚焦调度。反直觉的是,后期迭代可受益于非自然的复合响应模板,但ASR-Judge评估证实收益并非仅由格式或模板驱动。在两个标准有害行为基准上,相比离散后缀搜索、附加对抗嵌入及基于搜索的生成式攻击,PEO均表现更优。

原文摘要 · Abstract (English)

Existing white-box jailbreak attacks against aligned LLMs typically append discrete adversarial suffixes to the user prompt, which visibly alters the prompt and operates in a combinatorial token space. Prior work has avoided directly optimizing the embeddings of the original prompt tokens, presumably because perturbing them risks destroying the prompt's semantic content. We propose Prompt Embedding Optimization (PEO), a multi-round white-box jailbreak that directly optimizes the embeddings of the original prompt tokens without appending any adversarial tokens, and show that the concern is unfounded: the optimized embeddings remain close enough to their originals that the visible prompt string is preserved exactly after nearest-token projection, and quantitative analysis shows the model's responses stay on topic for the large majority of prompts. PEO combines continuous embedding-space optimization with structured continuation targets and an adaptive failure-focused schedule. Counterintuitively, later PEO rounds can benefit from heuristic composite response scaffolds that are not natural standalone templates, yet ASR-Judge shows that the resulting gains are not merely empty formatting or scaffold-only outputs. Across two standard harmful-behavior benchmarks and competing white-box attacks spanning discrete suffix search, appended adversarial embeddings, and search-based adversarial generation, PEO outperforms all of them in our experiments.

LLM安全越狱攻击嵌入优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。