现有大模型安全评估方法无法发现内部表示的脆弱性。
When Behavioral Safety Evaluation Fails: A Representation-Level Perspective

- 从表示层出发,构建看似安全实则易被操控的模型
- 微小扰动可使安全模型转为有害响应,成功率54%~86%
- 适合关注模型深层安全机制的研究者与评测人员
大语言模型的安全评估主要依赖行为表现:若模型拒绝有害请求并正确回应良性问题,则视为安全。然而,仅在审计者尝试的提示上拒绝,并不能说明模型远离有害行为。行为测试只观察输出,未衡量对模型内部状态施加干预后,其拒绝能力被突破的难易程度。我们定义这一差距为“审计差距”,并证明其可实现:可构建一个在所有静态审计中表现与安全基线一致的模型,却能被已知的微小内部扰动轻易攻破。我们在Gemma 2 2B、Llama 3.2 3B和Qwen 2.5 3B三个基线上构造此类解离模型,并使用相同的参数空间与潜在空间软攻击进行测试。潜在攻击通过潜伏脆弱性评分(LVS)量化,即单位有界潜变量扰动引发的安全退化。所有静态审计均对解离模型与基线给出相同结论:拒绝行为一致、越狱无固定特征、干净激活的强探测无法区分。但相同干预手段可逆转其安全性评定。在目标中间层,解离模型的LVS为基线的2.5至3.1倍。有界潜变量攻击使54%至86%的提示触发有害响应,而基线仅为3%至48%,随机扰动则始终低于12%。有害微调仅需5步梯度更新即达高响应率,基线则需10至25步。行为测试,包括静态潜在探测,无法认证表示层鲁棒性:安全审计必须主动干预模型,而不仅观察输出。
原文摘要 · Abstract (English)
Safety evaluation of large language models (LLMs) is largely behavioral: a model is certified safe when it refuses harmful requests and answers benign ones. But refusing on the prompts an auditor happens to try does not show that the model is far from harmful behavior. Behavioral tests observe outputs; they do not measure how easily an intervention on the model turns a refusal into compliance. We call the gap between what static audits certify and what an intervention can reach the audit gap, and we show it is realizable: one can build a model that matches its safety-aligned base on every static audit yet gives way to a small, known perturbation of its internal state. We construct such dissociated models from three safety-aligned bases (Gemma 2 2B, Llama 3.2 3B, Qwen 2.5 3B) and audit the base, dissociated, and openly harmful models with the same soft interventions in parameter and latent space; the latent attacks are summarized by the Latent Vulnerability Score (LVS), the safety degradation produced per unit of bounded latent perturbation. Every static audit we run gives the dissociated model the same verdict as its base, since its refusals match the base, jailbreaks show no consistent signature, and a strong fixed probe on clean activations cannot tell it from the base. The same interventions an auditor could run reverse the verdict. At the targeted mid layer the dissociated models score 2.5 to 3.1 times higher LVS than their bases. A bounded latent attack elicits harmful compliance on 54 to 86% of prompts, against 3 to 48% for the bases, while matched random perturbations stay at or below 12%. Harmful fine-tuning reaches high compliance within five gradient steps, where the bases need 10 to 25. Behavioral testing, even with static latent probing, cannot certify representation-level robustness: a safety audit must intervene on the model, not only observe it.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。