arXiv:2602.06911cs.CRcs.AI2026-02KDD被引 4

首个系统评估大模型抗篡改能力的框架,可测试21个模型在9种攻击下的安全与性能表现。

TamperBench: Systematically Stress-Testing LLM Safety Under Fine-Tuning and Tampering

  • 构建统一评测框架,涵盖权重和隐空间攻击及对齐阶段防御方法。
  • 实测显示越狱微调是最严重威胁,现有防御多数无法抵御系统性攻击。
  • 适合关注模型安全性、对抗攻击或防御评估的研究者使用。

随着具备开放权重的大语言模型(LLMs)日益广泛应用,提升其对不安全修改(无论是意外还是恶意)的抗篡改能力变得至关重要。然而,目前尚无标准化方法来评估这种抗性。不同数据集、指标和篡改配置使得模型间安全、效用与鲁棒性的比较困难。为此,我们提出 TamperBench,首个系统化评估 LLM 抗篡改能力的统一框架。该框架(i)整理了当前最先进的权重空间微调攻击、隐空间表示攻击及对齐阶段防御方法;(ii)通过针对每对攻击-模型进行系统性超参数扫描,实现更真实的对抗评估;(iii)提供安全性和实用性双重评估。我们利用 TamperBench 对 21 个开源权重的 LLM(包括增强防御版本)在九种篡改威胁下进行了评估,采用标准化的安全与能力指标,并对每个模型-攻击对执行超参数扫描。结果揭示了后训练对抵抗能力的影响,发现越狱微调通常是危害最严重的攻击类型,且当前对齐阶段的防御措施在系统性攻击下普遍失效。代码已公开于 https://github.com/criticalml-uw/TamperBench。

原文摘要 · Abstract (English)

As increasingly capable open-weight large language models (LLMs) are deployed, improving their tamper resistance against unsafe modifications, whether accidental or intentional, becomes critical to minimize risks. However, there is no standard approach to evaluate tamper resistance. Varied datasets, metrics, and tampering configurations make it difficult to compare safety, utility, and robustness across different models and defenses. To address this, we introduce TamperBench, the first unified framework to systematically evaluate the tamper resistance of LLMs. TamperBench (i) curates a repository of state-of-the-art weight-space fine-tuning attacks, latent-space representation attacks, and alignment-stage defenses; (ii) enables realistic adversarial evaluation through systematic hyperparameter sweeps per attack-model pair; and (iii) provides both safety and utility evaluations. We use TamperBench to evaluate 21 open-weight LLMs, including defense-augmented variants, across nine tampering threats using standardized safety and capability metrics with hyperparameter sweeps per model-attack pair. The results provide insights including effects of post-training on tamper resistance, that jailbreak-tuning is typically the most severe attack, and that current alignment-stage defenses largely fail to withstand attack sweeps. Code is available at https://github.com/criticalml-uw/TamperBench.

模型安全对抗攻击评测基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。