提出加权方法解决缺失数据下的预测置信度问题
Weighted Conformal Prediction Provides Adaptive and Valid Mask-Conditional Coverage for General Missing Data Mechanisms

- 先插补再校正,通过重加权修正预测集
- 在多种缺失机制下保证覆盖率和条件有效性
- 比传统方法更精确,适合真实缺失数据场景
分位数预测(CP)为不确定性量化提供理论框架,但在存在缺失协变量时无法保证覆盖率。针对不同缺失模式带来的异质性,掩码条件有效覆盖(MCV)比边际覆盖更优。本文提出预插补-掩码-校正框架,将分裂CP扩展至处理缺失值,可保证一般缺失机制下的边际覆盖率与掩码条件有效性。核心是重加权的共形预测过程,用于修正分布插补(多重插补)后的校准数据集预测集,兼容标准插补流程。推导出两种算法,证明其近似满足边际有效性与MCV。在合成与真实数据集上评估,相比标准MCV方法显著缩小预测区间宽度,同时保持目标覆盖率。
原文摘要 · Abstract (English)
Conformal prediction (CP) offers a principled framework for uncertainty quantification, but it fails to guarantee coverage when faced with missing covariates. In addressing the heterogeneity induced by various missing patterns, Mask-Conditional Valid (MCV) Coverage has emerged as a more desirable property than Marginal Coverage. In this work, we adapt split CP to handle missing values by proposing a preimpute-mask-then-correct framework that can offer valid coverage. We show that our method provides guaranteed Marginal Coverage and Mask-Conditional Validity for general missing data mechanisms. A key component of our approach is a reweighted conformal prediction procedure that corrects the prediction sets after distributional imputation (multiple imputation) of the calibration dataset, making our method compatible with standard imputation pipelines. We derive two algorithms, and we show that they are approximately marginally valid and MCV. We evaluate them on synthetic and real-world datasets. It reduces significantly the width of prediction intervals w.r.t standard MCV methods, while maintaining the target guarantees.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。