arXiv:2510.11570cs.CRcs.CL2025-10被引 4

简单加几个符号就能骗过大模型的安全审查,漏洞极深。

Bag of Tricks for Subverting Reasoning-based Safety Guardrails

  • 用模板符号扰动输入,让安全审查失效
  • 攻击成功率超90%,跨多个模型和平台有效
  • 揭示开源大模型安全机制的系统性缺陷

近期基于推理的安全防护机制(如思辨对齐)在大型推理模型中表现出强大的防御能力,能通过分析用户输入意图拒绝有害请求。然而,我们发现这些机制极易被输入提示的细微扰动所攻破:仅添加少量模板标记即可绕过防护,导致生成明确有害内容。为此,我们提出一套涵盖白盒、灰盒和黑盒攻击的越狱方法,从简单模板修改到全自动优化均可实现。该方法在5个基准测试中对gpt-oss系列模型的攻击成功率均超过90%,适用于本地部署与在线API服务。评估覆盖多个主流开源推理模型,证实此类漏洞具有系统性。亟需更强的对齐技术以防范恶意滥用。代码已开源:https://chenxshuo.github.io/bag-of-tricks。

原文摘要 · Abstract (English)

Recent reasoning-based safety guardrails for Large Reasoning Models (LRMs), such as deliberative alignment, have shown strong defense against jailbreak attacks. By leveraging LRMs' reasoning ability, these guardrails help the models to assess the safety of user inputs before generating final responses. The powerful reasoning ability can analyze the intention of the input query and will refuse to assist once it detects the harmful intent hidden by the jailbreak methods. Such guardrails have shown a significant boost in defense, such as the near-perfect refusal rates on the open-source gpt-oss series. Unfortunately, we find that these powerful reasoning-based guardrails can be extremely vulnerable to subtle manipulation of the input prompts, and once hijacked, can lead to even more harmful results. Specifically, we first uncover a surprisingly fragile aspect of these guardrails: simply adding a few template tokens to the input prompt can successfully bypass the seemingly powerful guardrails and lead to explicit and harmful responses. To explore further, we introduce a bag of jailbreak methods that subvert the reasoning-based guardrails. Our attacks span white-, gray-, and black-box settings and range from effortless template manipulations to fully automated optimization. Along with the potential for scalable implementation, these methods also achieve alarmingly high attack success rates (e.g., exceeding 90% across 5 different benchmarks on gpt-oss series on both local host models and online API services). Evaluations across various leading open-source LRMs confirm that these vulnerabilities are systemic, underscoring the urgent need for stronger alignment techniques for open-sourced LRMs to prevent malicious misuse. Code is open-sourced at https://chenxshuo.github.io/bag-of-tricks.

安全防护越狱攻击大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。