arXiv:2602.11786cs.LGcs.AI2026-02被引 2

通过反复测试提示,发现大模型在持续使用中隐藏的安全风险。

Evaluating LLM Safety Under Repeated Inference via Accelerated Prompt Stress Testing

  • 对同一提示反复推理,模拟真实使用场景下的稳定性问题。
  • 相同评分的模型在重复测试中失败率差异可达数倍以上。
  • 适合关注模型长期可靠性与安全性的研发和部署人员。

传统大语言模型评测(如 HELM、AIR-BENCH)主要通过多任务、多风险类别的广度评估来衡量安全性。然而,在实际部署中,更关键的风险是:在相同或近似提示的持续推理下出现的操作性故障,而非单一任务表现不佳。高风险场景中,响应的一致性和持续使用的安全性至关重要。本文提出加速提示压力测试(APST),借鉴可靠性工程中的加速应力测试思想,通过在受控条件下(如解码温度)重复采样相同提示,揭示隐性故障模式,包括幻觉、拒绝不一致和不安全输出。APST将故障视为重复推理下的随机事件,采用伯努利与二项分布建模,估算每轮推理的失败概率。在基于 AIR-BENCH 2024 安全与安全提示对多个指令微调模型进行测试时,发现即使浅层评估得分相近,不同模型在重复采样下的实际失败率仍存在显著差异。结果表明,单次或低深度评估可能掩盖部署相关可靠性的真实差异。APST为估计持续使用下的故障频率提供了实用框架,并支持模型与解码配置间的安全性可靠性比较。

原文摘要 · Abstract (English)

Traditional benchmarks for large language models (LLMs), such as HELM and AIR-BENCH, primarily assess safety through breadth-oriented evaluation across diverse tasks and risk categories. However, real-world deployment often exposes a different class of risk: operational failures that arise under repeated inference on identical or near-identical prompts rather than from broad task-level underperformance. In high-stakes settings, response consistency and safety under sustained use are therefore critical. We introduce Accelerated Prompt Stress Testing (APST), a depth-oriented evaluation framework inspired by highly accelerated stress testing in reliability engineering. APST repeatedly samples identical prompts under controlled operational conditions (such as decoding temperature) to surface latent failure modes including hallucinations, refusal inconsistency, and unsafe completions. Rather than treating failures as isolated events, APST models them as stochastic outcomes of repeated inference and uses Bernoulli and binomial formulations to estimate per-inference failure probabilities. Applying APST to multiple instruction-tuned LLMs evaluated on AIR-BENCH 2024--derived safety and security prompts, we find that models with comparable shallow-evaluation scores can exhibit substantially different empirical failure rates under repeated sampling. These results show that single-sample or low-depth evaluation can obscure meaningful differences in deployment-relevant reliability. APST complements existing benchmark methodologies by providing a practical framework for estimating failure frequency under sustained use and comparing safety reliability across models and decoding configurations.

大模型安全压力测试可靠性评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。