解决在线预测中反馈被污染时的置信集校准问题
Online Conformal Prediction with Corrupted Feedback

- 将反馈污染建模为任意二值翻转序列,分析其对传统方法的影响
- 提出两种鲁棒方案:基于阈值结构过滤和主动补偿机制
- 在真实数据上验证,显著提升校准性并缩小预测集
现代人工智能系统需要在顺序和非平稳环境中保持可靠的不确定性估计。在线合取预测(OCP)通过自适应更新的预测集提供确定性的长期误覆盖保证,但该保证依赖于对过去预测集覆盖情况的完美反馈。实践中,观测到的误覆盖指示可能因噪声、通信故障或对抗性操纵而被污染,严重损害OCP的校准性能。本文研究了反馈污染下的OCP问题,首先将反馈污染建模为任意二值翻转序列,分析其对标准OCP误覆盖性能的影响;随后提出两种鲁棒方法:基于过滤的鲁棒OCP利用预测阈值的结构特性过滤污染反馈,基于主动补偿的鲁棒OCP引入主动补偿机制减轻污染影响。针对两种方法,建立了明确的误覆盖保证,并进一步针对独立随机翻转模型与有记忆边界任意误差模型进行特殊化。在真实数据集上的实验验证了所提方法的有效性,在反馈受污染条件下显著提升了校准性且预测集更小。
原文摘要 · Abstract (English)
Modern artificial intelligence systems require calibrated uncertainty estimates that remain reliable in sequential and non-stationary environments. Online conformal prediction (OCP) addresses this challenge through adaptively updated prediction sets that provide deterministic long-run miscoverage guarantees. These guarantees, however, hinge on the assumption of perfect feedback about the coverage of past prediction sets. In practice, the observed miscoverage indicator may be corrupted by noise, communication failures, or adversarial manipulation, which can severely degrade OCP's calibration guarantees. In this paper, we study OCP under corrupted feedback. We first model feedback corruption as an arbitrary binary flip sequence, and analyze how feedback corruption affects and degrades the miscoverage performance of standard OCP. We then propose two robust schemes: robust OCP via filtering, which leverages the structural properties of the predicted threshold to filter corrupted feedback, and robust OCP via active compensation, which incorporates an active compensation mechanism to mitigate the effect of corrupted feedback. For both methods, we establish explicit miscoverage guarantees, which are further specialized for an independent stochastic flip model and for an arbitrary error model with memory bounds. Experiments on real-world datasets validate the proposed approach, showing markedly improved calibration and significantly smaller prediction sets compared with baseline OCP methods under corrupted feedback.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。