提出SABER方法,用小样本预测大模型对抗风险,更真实评估安全漏洞。
Statistical Estimation of Adversarial Risk in Large Language Models under Best-of-N Sampling
- 用贝塔分布建模每轮攻击成功率,推导可外推的缩放规律。
- 仅用100次采样,预测1000次攻击成功率误差降低86.2%。
- 揭示模型看似安全实则易被并行攻击突破,适合安全评估研究者。
大型语言模型通常在单次或低预算对抗提示下评估安全性,这低估了真实风险。现实中,攻击者可通过大规模并行采样反复探测模型,直至生成有害响应。尽管已有研究指出重复采样会提升攻击成功率,但针对大规模对抗风险的系统性预测方法仍有限。本文提出一种面向最佳-第N采样的风险估计方法SABER,通过贝塔分布建模样本级成功概率(贝努利分布的共轭先验),推导出解析缩放定律,实现从低预算测量可靠外推高规模攻击成功率。仅使用n=100次采样,其锚定估计器预测ASR@1000的平均绝对误差为1.66,相比基线的12.04降低86.2%。结果揭示了异质的风险缩放特性,表明在标准评估中看似稳健的模型,在并行对抗压力下可能经历非线性风险激增。本工作提供了一种低成本、可扩展的现实化大模型安全评估方法。代码与评估脚本将在发表后公开。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are typically evaluated for safety under single-shot or low-budget adversarial prompting, which underestimates real-world risk. In practice, attackers can exploit large-scale parallel sampling to repeatedly probe a model until a harmful response is produced. While recent work shows that attack success increases with repeated sampling, principled methods for predicting large-scale adversarial risk remain limited. We propose a scaling-aware Best-of-N estimation of risk, SABER, for modeling jailbreak vulnerability under Best-of-N sampling. We model sample-level success probabilities using a Beta distribution, the conjugate prior of the Bernoulli distribution, and derive an analytic scaling law that enables reliable extrapolation of large-N attack success rates from small-budget measurements. Using only n=100 samples, our anchored estimator predicts ASR@1000 with a mean absolute error of 1.66, compared to 12.04 for the baseline, which is an 86.2% reduction in estimation error. Our results reveal heterogeneous risk scaling profiles and show that models appearing robust under standard evaluation can experience rapid nonlinear risk amplification under parallel adversarial pressure. This work provides a low-cost, scalable methodology for realistic LLM safety assessment. We will release our code and evaluation scripts upon publication to future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。