用计算量评估大模型对抗攻击风险,更真实反映攻击成本。
Risk Under Pressure: Compute-Aware Evaluation of Adversarial Robustness in Language Models

- 以累计浮点运算量为压力指标,衡量攻击实际计算成本。
- 不同攻击方式成本差达5倍,且对齐训练影响非单调。
- 适合关注安全攻防成本的模型开发者与评测者。
大型语言模型的对抗鲁棒性评估通常在固定查询预算下报告攻击成功率(ASR),隐含假设所有攻击成本相同。实际上,不同攻击策略的计算开销可相差数个数量级。因此,在固定预算下的ASR会掩盖真实攻击所需努力,难以判断攻击成本是否值得。本文提出基于计算压力(以累计浮点运算量FLOPs衡量)的评估框架,引入风险-计算曲线,量化达成攻击成功所需的平均计算压力。在三个模型家族、四个训练阶段的十种模型上,使用三种攻击策略(基于梯度、迭代优化、模板)在两个越狱鲁棒性基准测试中验证:(1) 对齐训练对计算空间鲁棒性的影响呈非单调;(2) 模型规模扩大降低基于梯度攻击效果,但对低成本模板攻击影响有限;(3) 在代理模型上优化的梯度攻击可迁移到目标模型,降低攻击者成本;(4) 单一模型内不同危害类别间计算成本差异达约5倍;(5) 安全对齐强化学习虽提升总体成本,但部分类别仍相对易攻。我们开源该框架,支持计算感知的风险评估。
原文摘要 · Abstract (English)
Adversarial robustness evaluations of large language models (LLMs) typically report attack success rate (ASR) under fixed query budgets, implicitly treating all attacks as equally costly. In practice, the computational expense of different attack strategies can vary by orders of magnitude. Consequently, ASR at a fixed budget can obscure the true effort required to jailbreak a model, thereby making it hard to determine whether an attack's cost justifies its payoff to the attacker. We propose a compute-aware evaluation framework based on computational pressure, measured in cumulative floating-point operations (FLOPs), as a proxy for adversarial effort. We introduce risk-compute curves, which map compute budgets to attack risk, and derive two metrics that summarize the average pressure required for a given attack to succeed. Across ten models spanning three families and four different stages in language model training and alignment, evaluated with three attack strategies (gradient-based, iterative refinement, and template-based) on two jailbreak robustness benchmarks, we find: (1) alignment training has non-monotonic effects on compute-space robustness; (2) scaling model size reduces gradient-based attack effectiveness but has limited impact on cheaper template-based attacks; (3) gradient-based attacks optimized on a surrogate model can transfer to a separate target model, providing a way to reduce attacker costs; (4) compute cost varies by up to ${\approx}5{\times}$ across harm categories within a single model; and (5) safety-aligned RL increases aggregate cost while leaving some categories disproportionately accessible. We release our framework to enable compute-aware risk assessment and evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。