针对提示和领域漂移,实现动态风险控制的自适应校准方法
PromptShift-CRC: Drift-Aware Conformal Risk Control for Foundation Models Under Prompt and Domain Shift

- 基于提示嵌入与漂移检测,动态加权校准样本
- 在线调整风险水平,漂移后仍保持95%以上覆盖率
- 适合高变化场景下的安全推理,如问答与内容审核
基础模型在实际应用中常面临提示快速变化的情况,导致校准数据与未来数据分布不一致,固定校准方式风险显著。本文提出 PromptShift CRC,一种面向提示与领域漂移的自适应共形风险控制方法。该方法通过嵌入提示与响应,量化当前提示流与校准池的偏离程度,对相关或近期样本赋予更高权重,并在观测到误差后在线更新风险水平。方法提供三项实用诊断:实际风险误差、提示漂移度与有效校准规模。理论证明其风险控制能力受分布偏差和加权分位数不确定性的限制。在合成提示漂移基准测试中,静态共形风险控制在漂移后覆盖率骤降,而 PromptShift-CRC 在所有自适应基线中表现最佳。随后在公开基准衍生的数据流上评估了相同校准层,涵盖问答、毒性检测、摘要事实性及长上下文幻觉风险等任务。
原文摘要 · Abstract (English)
Foundation models are now used in settings where the prompts they receive can change quickly. Users change, topics change, policies change, and the model may suddenly face a kind of request that was rare in the calibration data. This makes fixed calibration risky. Conformal prediction and conformal risk control give model-agnostic ways to control error, but they work best when the calibration data still look like the future data. This paper develops PromptShift CRC, a drift-aware conformal risk control method for foundation-model outputs under prompt and domain shift. The method embeds prompts and responses, measures how far the current prompt stream has moved from the calibration pool, gives more weight to relevant or recent calibration examples, and updates the risk level online after observed violations. It reports three practical diagnostics: realized risk error, prompt drift, and effective calibration size. We give conditions under which the method controls risk up to terms for distribution mismatch and weighted quantile uncertainty. In a synthetic prompt-shift benchmark, static conformal risk control fails sharply after drift, while PromptShift-CRC gives the best coverage among the adaptive baselines considered. We then evaluate the same calibration layer on public benchmark derived streams for question answering, toxicity, summarization factuality, and long-context hallucination risk
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。