通过分析模型内部表示,无须外部评判即可量化安全机制强弱。
Silent Alarm: A J-Space Protocol for Comparing Danger Recognition Across Models and Quantization Levels

- 用雅可比空间分析模型生成前的内部表征,捕捉潜在危险识别能力。
- 在六种模型、三种量化级别下,安全AUC指标显著区分强弱安全机制。
- 适合研究模型安全性的研究人员,尤其关注量化对安全性影响者。
当前的越狱鲁棒性评估多依赖大模型作为评判者,但此类方法易受评分流程影响,且仅反映表面行为,无法揭示底层安全机制的隐藏脆弱性。本文提出JADR(雅可比危险识别评估)协议,通过分析模型生成首个响应前的雅可比空间(J-space,一种可语义化概念的表征空间)激活情况,记录每层中前k个J-space关键项,并将其归入六类行为轴线,对比基于StrongREJECT的危险样本与来自XSTest和OKTest的安全对照样本。该方法完全本地运行,不依赖外部评判模型,可直接比较不同模型及同一模型在量化与微调等修改下的表现。最终采用安全AUC指标结合自助法置信区间进行评估。实验覆盖六种模型(Qwen3-1.7B、Qwen3-4B、Qwen3-8B、Qwen3-Uncensored-4B、Qwen3-SafeRL-4B、Gemma 2 9B)在BF16、INT8、INT4三种权重表示下的表现,并与独立的行为评估(StrongREJECT评分器)验证。结果表明,该指标能以统计显著性区分强/弱内部安全机制,并捕捉量化对安全性的实质性影响。
原文摘要 · Abstract (English)
Jailbreak-robustness research typically evaluates safety through generated responses using an LLM-as-judge approach. Such evaluations, however, are sensitive to the benchmark's grading procedure and capture only observed behavior on a given set of attacks, without directly revealing the hidden fragility of the underlying safety mechanisms. This work proposes JADR (Jacobian Assessment of Danger Recognition), a protocol that measures a model's internal representation through Jacobian space (J-space, a recently proposed workspace of verbalizable concepts) before the first response token is generated. For every prompt and layer we record the top-k J-space tokens; these are grouped into six behavioral scenario axes and compared between a danger sample based on StrongREJECT and a safe control drawn from XSTest and OKTest. The method does not call on an external judge model: the computation runs entirely locally, on the activations of the model under evaluation, which lets us compare both different models against each other and modifications of a single model - quantization and fine-tuning in particular - on the same terms. The final comparison rests on the proposed SafetyAUC metric, complemented with bootstrap confidence intervals. The protocol is applied to six models (Qwen3-1.7B, Qwen3-4B, Qwen3-8B, Qwen3-Uncensored-4B, Qwen3-SafeRL-4B, Gemma 2 9B) across three weight-representation regimes - BF16, INT8, and INT4 - and checked against an independent behavioral evaluation with the StrongREJECT grader. The metric separates models with a strong versus a weak internal safety mechanism with statistical significance and captures substantively different effects across quantization regimes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。