arXiv:2607.07184cs.LGcs.AI2026-07被引 2

用历史对话模拟真实部署,提前预测大模型上线后的安全风险。

Predicting LLM Safety Before Release by Simulating Deployment

论文配图:Predicting LLM Safety Before Release by Simulating Deployment
图 1 · 摘自论文原文
  • 基于旧模型对话生成新模型响应,模拟真实使用场景
  • 预测的错误行为发生率与实际部署数据高度吻合
  • 可基于公开数据集开展评估,适合外部研究者使用

预发布安全评估旨在揭示新AI模型上线后的潜在风险。然而,现有评估覆盖不足、代表性差,且容易被识别为测试。为此,我们提出一种简单部署模拟方法:保留先前模型部署中去标识化对话的初始前缀,用候选模型重生成后续回应。生成结果既可用于检测新型对齐偏差,也可估算模型误行为的普遍性。我们在四个GPT-5系列版本上评估该方法,对GPT-5.4采用注册、结果盲测预测,对三个早期版本进行回溯分析。结果显示,部署模拟能提供有信息量的后发布误行为率估计,优于基于对抗性选取生产数据的基线;其评估感知点估计值也更接近真实流量表现。我们还发现工具调用重采样的真实性是提升预测能力的关键挑战,并表明即使在复杂工具使用场景下该挑战亦可克服。最后,我们证明该模拟可基于公共聊天数据集启动,仍能有效反映生产环境中的误行为率,为无权访问私有日志的研究者提供了部署基准评估路径。总体而言,部署模拟有助于预测语言模型在真实世界中的表现,支持更量化的发布风险评估。

原文摘要 · Abstract (English)

Pre-deployment safety evaluations aim to inform the downstream risks of releasing a new AI model. Yet most evaluations provide limited evidence about how often undesired model behavior will occur in deployment: they generally have insufficient coverage, are unrepresentative, and are generally recognizable as tests. To address these concerns, we study a simple way to simulate a model deployment: starting from de-identified conversations from a previous model deployment, we hold fixed the initial conversation prefix and regenerate the next response using a candidate model. The resulting responses can then both be audited for novel misalignments and used to estimate the prevalence of model misbehavior before deployment. We evaluate deployment simulation across four GPT-5-series deployments, using registered, outcome-blinded predictions for GPT-5.4 and retrospective analyses of three earlier releases. We find that deployment simulation produces informative estimates of post-deployment misbehavior rates and outperforms baselines based on adversarially selected production data; its evaluation-awareness point estimates were also much closer to production traffic than those from traditional evaluations. We also identify the realism of tool resampling as a central challenge for further improving predictions and share results suggesting that this challenge is surmountable even in complex tool-use settings. Finally, we show that deployment simulation can be seeded from public chat datasets and remain informative about production misbehavior rates, suggesting a path for external researchers to run deployment-grounded evaluations without access to private production logs. Overall, deployment simulation helps evaluators forecast how language models will behave in the real world and supports more quantitative assessment of deployment risk.

大模型安全部署模拟风险预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。