arXiv:2607.12792cs.CRcs.AI2026-07被引 1

通过分析模型内部表示,无须外部评判即可量化安全机制强弱。

Silent Alarm: A J-Space Protocol for Comparing Danger Recognition Across Models and Quantization Levels

论文配图:Silent Alarm: A J-Space Protocol for Comparing Danger Recognition Across Models and Quantization Levels
图 1 · 摘自论文原文
  • 用雅可比空间分析模型生成前的内部表征,捕捉潜在危险识别能力。
  • 在六种模型、三种量化级别下,安全AUC指标显著区分强弱安全机制。
  • 适合研究模型安全性的研究人员,尤其关注量化对安全性影响者。

当前的越狱鲁棒性评估多依赖大模型作为评判者,但此类方法易受评分流程影响,且仅反映表面行为,无法揭示底层安全机制的隐藏脆弱性。本文提出JADR(雅可比危险识别评估)协议,通过分析模型生成首个响应前的雅可比空间(J-space,一种可语义化概念的表征空间)激活情况,记录每层中前k个J-space关键项,并将其归入六类行为轴线,对比基于StrongREJECT的危险样本与来自XSTest和OKTest的安全对照样本。该方法完全本地运行,不依赖外部评判模型,可直接比较不同模型及同一模型在量化与微调等修改下的表现。最终采用安全AUC指标结合自助法置信区间进行评估。实验覆盖六种模型(Qwen3-1.7B、Qwen3-4B、Qwen3-8B、Qwen3-Uncensored-4B、Qwen3-SafeRL-4B、Gemma 2 9B)在BF16、INT8、INT4三种权重表示下的表现,并与独立的行为评估(StrongREJECT评分器)验证。结果表明,该指标能以统计显著性区分强/弱内部安全机制,并捕捉量化对安全性的实质性影响。

原文摘要 · Abstract (English)

Jailbreak-robustness research typically evaluates safety through generated responses using an LLM-as-judge approach. Such evaluations, however, are sensitive to the benchmark's grading procedure and capture only observed behavior on a given set of attacks, without directly revealing the hidden fragility of the underlying safety mechanisms. This work proposes JADR (Jacobian Assessment of Danger Recognition), a protocol that measures a model's internal representation through Jacobian space (J-space, a recently proposed workspace of verbalizable concepts) before the first response token is generated. For every prompt and layer we record the top-k J-space tokens; these are grouped into six behavioral scenario axes and compared between a danger sample based on StrongREJECT and a safe control drawn from XSTest and OKTest. The method does not call on an external judge model: the computation runs entirely locally, on the activations of the model under evaluation, which lets us compare both different models against each other and modifications of a single model - quantization and fine-tuning in particular - on the same terms. The final comparison rests on the proposed SafetyAUC metric, complemented with bootstrap confidence intervals. The protocol is applied to six models (Qwen3-1.7B, Qwen3-4B, Qwen3-8B, Qwen3-Uncensored-4B, Qwen3-SafeRL-4B, Gemma 2 9B) across three weight-representation regimes - BF16, INT8, and INT4 - and checked against an independent behavioral evaluation with the StrongREJECT grader. The metric separates models with a strong versus a weak internal safety mechanism with statistical significance and captures substantively different effects across quantization regimes.

模型安全量化影响内部表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。