不重训模型即可动态修正安全分类器误判,还能自动检测数据漂移。
Regime-Conditional Verification: Correctness Estimation for Adapting and Monitoring Safety Classifiers
- 通过分析模型内部表示,估计预测偏离部署方策略的概率。
- 在三个分类器上提升策略遵循度,最多捕获81%此前漏判的有害内容。
- 适合需要持续监控与轻量维护的安全系统部署者使用。
部署于大语言模型的安全分类器常因训练策略与部署方期望不符,或随流量演变导致性能下降而失效。我们提出轻量级封装方法Regime-Conditional Verification(RCV),无需重新训练即可适配现成安全分类器。RCV从分类器内部表征中估计每条预测与部署方策略不一致的概率,并对高风险预测进行选择性修正。同一估计信号还提供无标签的分布漂移检测能力,形成维护闭环:仅在必要时才对分类器进行微调。在三个现成安全分类器和两个基准数据集上,所有组合均提升策略遵循度,最多捕获0.81的此前漏判有害内容。在十组持留攻击场景的部署实验中,RCV在专用注入面板中成功检测全部攻击;多数数据漂移可通过修正修复,仅残余样本需微调。
原文摘要 · Abstract (English)
Safety classifiers deployed with large language models often fail for two reasons: their decisions reflect the policy learned during training rather than the deployer's desired policy, and their performance degrades as deployment traffic evolves. We present Regime-Conditional Verification (RCV), a lightweight wrapper that adapts an off-the-shelf safety classifier without retraining it. RCV estimates, from the classifier's internal representations, the probability that each prediction disagrees with the deployer's policy, and selectively corrects predictions likely to be wrong. The same correctness estimates also provide a label-free signal for detecting distribution shift, enabling a maintenance loop that updates the correctness estimation layer and resorts to classifier fine-tuning only when necessary. Across three off-the-shelf safety classifiers and two benchmark datasets, RCV improves adherence to the deployer's policy in every classifier-dataset combination, catching up to 0.81 of previously missed unsafe content without modifying the underlying classifier. In a deployment study with ten attack campaigns, each a harm category held out of RCV's training, RCV detects every campaign in a dedicated injection panel; in the maintenance census most drift episodes are repaired without updating the classifier, and the fine-tune is reserved for the residual episodes that repair does not restore.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。