arXiv:2601.03420cs.LGcs.AI2026-01

无需梯度或先验,用随机迭代搜索实现高效越狱攻击

Jailbreaking LLMs Without Gradients or Priors: Effective and Transferable Attacks

  • 通过逐令牌优化,仅利用模型输出概率进行攻击
  • 在多个开源模型上接近100%成功率,闭源模型转移率高
  • 可跨分词器攻击,发现通用越狱模式,适合安全评估

随着大语言模型在安全关键领域广泛应用,对其对抗性越狱攻击的鲁棒性评估至关重要。然而,现有自动化攻击常因受限假设而高估模型安全性,通常依赖手工设计的先验或需白盒访问以传播梯度。本文挑战这些限制,证明在无梯度和无先验条件下,基于令牌级的迭代优化仍可成功。提出RAILS(RAndom Iterative Local Search)框架,仅依赖模型logits进行操作。RAILS通过两项创新实现与梯度方法相当的效果:一种新型自回归损失,强制精确前缀匹配;一种基于历史的选择策略,弥合代理优化目标与真实攻击成功率之间的差距。关键在于,消除梯度依赖后,RAILS支持跨分词器集成攻击,可发现跨不同词汇表的共享对抗模式,显著提升对闭源系统(如GPT、Gemini)的迁移能力。实验表明,RAILS在多个开源模型上达到近100%成功率,并在黑盒场景下对闭源系统保持高转移性。

原文摘要 · Abstract (English)

As Large Language Models (LLMs) are increasingly deployed in safety-critical domains, rigorously evaluating their robustness against adversarial jailbreaks is essential. However, current safety evaluations often overestimate robustness because existing automated attacks are limited by restrictive assumptions. They typically rely on handcrafted priors or require white-box access for gradient propagation. We challenge these constraints by demonstrating that token-level iterative optimization can succeed without gradients or priors. We introduce RAILS (RAndom Iterative Local Search), a framework that operates solely on model logits. RAILS matches the effectiveness of gradient-based methods through two key innovations: a novel auto-regressive loss that enforces exact prefix matching, and a history-based selection strategy that bridges the gap between the proxy optimization objective and the true attack success rate. Crucially, by eliminating gradient dependency, RAILS enables cross-tokenizer ensemble attacks. This allows for the discovery of shared adversarial patterns that generalize across disjoint vocabularies, significantly enhancing transferability to closed-source systems. Empirically, RAILS achieves near 100% success rates on multiple open-source models and high black-box attack transferability to closed-source systems like GPT and Gemini.

越狱攻击黑盒攻击LLM安全迁移性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。