揭示大模型拒绝机制被场景绕过的内在原因,提出可复用的漏洞场景发现方法。
Do LLMs Know Their Vulnerable Scenarios?

- 通过稀疏自编码器构建概念空间,定位导致拒绝对话减弱的具体语义概念。
- 在3个开源模型上使攻击成功率最高提升18.2个百分点,且跨模型有效。
- 生成可解释的自然语言场景组合,支持迭代攻击并减少尝试次数。
安全对齐的大语言模型虽能拒绝有害请求,但将相同请求嵌入特定场景可绕过其防护机制。现有红队测试依赖经验性攻击结果识别有效场景,却无法解释为何某些场景会削弱拒绝行为。同时,机械可解释性研究虽刻画了拒绝方向与越狱特征,但未建立二者关联。本文发现,场景包裹提示会激活内部场景方向,其因果控制显著降低拒绝得分。基于此,我们提出 extsc{Concept2Scenario}——一种基于概念的漏洞场景发现框架:用稀疏自编码器实例化广泛概念空间,将拒绝抑制归因于单个概念,将识别出的概念转化为可解释的自然语言场景,并通过交互归因发现协同场景组合。在三个开源模型、两个安全基准和六种黑盒越狱方法中,所发现场景作为可复用先验,使平均攻击成功率提升最高达18.2个百分点。这些场景还成功迁移至GPT-5、Claude-Haiku-4.5与Gemini-3-Flash,表明部分场景级拒绝漏洞在模型族间共享。此外,组合场景优于单一成分,支持迭代攻击以更少轮次成功。
原文摘要 · Abstract (English)
Safety-aligned large language models are trained to refuse harmful requests, yet embedding the same requests in particular scenarios can bypass their safeguards. Existing red-teaming methods empirically identify effective scenarios through observed attack outcomes, but why particular scenarios weaken refusal remains mechanistically unclear. Meanwhile, mechanistic interpretability studies have characterized both refusal directions and jailbreak-associated features, without explaining the relationship between the two representations. In this work, we show that scenario-wrapped prompts activate internal scenario directions whose causal steering consistently reduces refusal scores. Building on this finding, we propose \textsc{Concept2Scenario}, a concept-based attribution framework for vulnerable scenario discovery. It instantiates a broad concept space with a sparse autoencoder, attributes refusal suppression to individual concepts, translates the identified concepts into interpretable natural-language scenarios, and identifies synergistic scenario combinations through interaction attribution. Across three open-source models, two safety benchmarks, and six black-box jailbreak methods, the discovered scenarios serve as reusable priors that improve average attack success rates by up to $18.2$ percentage points. They also transfer to GPT-5, Claude-Haiku-4.5, and Gemini-3-Flash, suggesting that some scenario-level refusal vulnerabilities are shared across model families. Moreover, the identified combinations outperform their individual constituents and enable iterative attacks to succeed in fewer turns.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。