arXiv:2602.15001cs.LG2026-02被引 7

黑盒攻击新方法突破最强语言模型防护屏障

Boundary Point Jailbreaking of Black-Box LLMs

  • 仅用单次查询是否被标记的反馈信息,实现全自动攻击
  • 在真实防御系统上成功生成通用越狱指令,无需人工种子
  • 适合安全研究者与防御机制开发者参考

前沿大模型通过分类器防御对抗性提示(越狱攻击)。近期防御系统已经过数千小时人工红队测试。本文提出边界点越狱(BPJ),一种全新的全自动黑盒攻击方法,可绕过当前工业级最强防护。不同于依赖分类器得分或梯度的白/灰盒攻击,或使用已有越狱语料库的方法,BPJ完全黑盒,每次查询仅需一个比特反馈:是否被分类器标记。其核心在于解决优化攻击的关键难题——如何判断一次修改是否提升攻击效果。BPJ将目标有害内容转化为一系列中间攻击目标,并主动选择能检测攻击强度微小变化的“边界点”进行评估。我们相信,这是首个在宪法分类器上成功生成通用越狱指令的全自动算法,也是首个无需人类攻击种子即可攻破GPT-5输入分类器的自动化方法。该攻击在单次交互中难以防御,但优化过程会产生大量触发警报,表明有效防御需结合批量监控而非仅依赖单次交互检测。

原文摘要 · Abstract (English)

Frontier LLMs are safeguarded against attempts to extract harmful information via adversarial prompts known as "jailbreaks". Recently, defenders have developed classifier-based systems that have survived thousands of hours of human red teaming. We introduce Boundary Point Jailbreaking (BPJ), a new class of automated jailbreak attacks that evade the strongest industry-deployed safeguards. Unlike previous attacks that rely on white/grey-box assumptions (such as classifier scores or gradients) or libraries of existing jailbreaks, BPJ is fully black-box and uses only a single bit of information per query: whether or not the classifier flags the interaction. To achieve this, BPJ addresses the core difficulty in optimising attacks against robust real-world defences: evaluating whether a proposed modification to an attack is an improvement. Instead of directly trying to learn an attack for a target harmful string, BPJ converts the string into a curriculum of intermediate attack targets and then actively selects evaluation points that best detect small changes in attack strength ("boundary points"). We believe BPJ is the first fully automated attack algorithm that succeeds in developing universal jailbreaks against Constitutional Classifiers, as well as the first automated attack algorithm that succeeds against GPT-5's input classifier without relying on human attack seeds. BPJ is difficult to defend against in individual interactions but incurs many flags during optimisation, suggesting that effective defence requires supplementing single-interaction methods with batch-level monitoring.

越狱攻击黑盒攻击大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。