用四阶段框架诊断大模型安全漏洞,发现输出阶段最弱。
Stop Testing Attacks, Start Diagnosing Defenses: The Four-Checkpoint Framework Reveals Where LLM Safety Breaks
- 将安全机制分为输入/输出与字面/意图四阶段,逐层检测
- 实测显示攻击成功率是传统评估的2.3倍,输出阶段漏洞率超70%
- 适合研究模型安全或开发防御系统的人员参考
大型语言模型(LLM)虽部署了安全机制以防止有害输出,但仍易受对抗性提示攻击。现有研究仅表明越狱攻击成功,却未揭示防御失效的具体位置与原因。为此,我们提出安全机制是一个分阶段的流水线,引入四阶段检测框架(Four-Checkpoint Framework),按处理阶段(输入/输出)与检测层级(字面/意图)划分出四个检查点(CP1–CP4),每个节点可独立评估。设计13种针对性逃避技术,针对特定检查点进行可控测试。在3,312个单轮黑盒测试中评估GPT-5、Claude Sonnet 4与Gemini 2.5 Pro。采用大模型为裁判进行响应分类,并引入加权攻击成功率(WASR)衡量部分信息泄露,优于二值化评估。结果表明:传统二值攻击成功率(ASR)为22.6%,而WASR达52.7%,实际脆弱性高出2.3倍;输出阶段防御(CP3、CP4)最弱,WASR达72–79%;输入字面层(CP1)最强,仅13%。Claude安全表现最优(42.8% WASR),其次GPT-5(55.9%)、Gemini(59.5%)。说明当前防御在输入字面层较强,但对意图级操纵和输出阶段攻击仍不稳固。该框架为定位与修复部署系统中的安全缺陷提供了结构化方法。
原文摘要 · Abstract (English)
Large Language Models (LLMs) deploy safety mechanisms to prevent harmful outputs, yet these defenses remain vulnerable to adversarial prompts. While existing research demonstrates that jailbreak attacks succeed, it does not explain \textit{where} defenses fail or \textit{why}. To address this gap, we propose that LLM safety operates as a sequential pipeline with distinct checkpoints. We introduce the \textbf{Four-Checkpoint Framework}, which organizes safety mechanisms along two dimensions: processing stage (input vs.\ output) and detection level (literal vs.\ intent). This creates four checkpoints, CP1 through CP4, each representing a defensive layer that can be independently evaluated. We design 13 evasion techniques, each targeting a specific checkpoint, enabling controlled testing of individual defensive layers. Using this framework, we evaluate GPT-5, Claude Sonnet 4, and Gemini 2.5 Pro across 3,312 single-turn, black-box test cases. We employ an LLM-as-judge approach for response classification and introduce Weighted Attack Success Rate (WASR), a severity-adjusted metric that captures partial information leakage overlooked by binary evaluation. Our evaluation reveals clear patterns. Traditional Binary ASR reports 22.6\% attack success. However, WASR reveals 52.7\%, a 2.3$\times$ higher vulnerability. Output-stage defenses (CP3, CP4) prove weakest at 72--79\% WASR, while input-literal defenses (CP1) are strongest at 13\% WASR. Claude achieves the strongest safety (42.8\% WASR), followed by GPT-5 (55.9\%) and Gemini (59.5\%). These findings suggest that current defenses are strongest at input-literal checkpoints but remain vulnerable to intent-level manipulation and output-stage techniques. The Four-Checkpoint Framework provides a structured approach for identifying and addressing safety vulnerabilities in deployed systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。