arXiv:2506.20898cs.LG2025-06被引 3

通过图结构反馈动态筛选有效模型,提升在线预测置信集效率

Multi-model Online Conformal Prediction with Graph-Structured Feedback

  • 用二分图收集反馈,每步筛选有效模型子集
  • 预测集更小,计算开销更低,仍满足覆盖率要求
  • 适合需要高效可靠预测的实时系统应用

在线共形预测能为每个新到来的数据点生成一个覆盖真实标签的预测集,且置信度可控。为应对分布漂移问题,多模型在线共形预测通过从预选模型集中选择并使用不同模型来增强灵活性。然而,候选集过大或包含低效模型会增加计算复杂度,并导致预测集过大。为此,本文提出一种新算法:利用二分图结构收集反馈,在每一步动态识别有效模型子集,并从中选取最优模型构建预测集,从而降低计算开销并缩小预测集。此外,实验表明结合预测集大小与模型损失作为反馈信号,可显著提升效率,在保证覆盖率的前提下生成更小的预测集。理论证明该方法具有有效的覆盖率和次线性遗憾。在真实与合成数据集上的实验验证了其优越性。

原文摘要 · Abstract (English)

Online conformal prediction has demonstrated its capability to construct a prediction set for each incoming data point that covers the true label with a predetermined probability. To cope with potential distribution shift, multi-model online conformal prediction has been introduced to select and leverage different models from a preselected candidate set. Along with the improved flexibility, the choice of the preselected set also brings challenges. A candidate set that includes a large number of models may increase the computational complexity. In addition, the inclusion of irrelevant models with poor performance may negatively impact the performance and lead to unnecessarily large prediction sets. To address these challenges, we propose a novel multi-model online conformal prediction algorithm that identifies a subset of effective models at each time step by collecting feedback from a bipartite graph, which is refined upon receiving new data. A model is then selected from this subset to construct the prediction set, resulting in reduced computational complexity and smaller prediction sets. Additionally, we demonstrate that using prediction set size as feedback, alongside model loss, can significantly improve efficiency by constructing smaller prediction sets while still satisfying the required coverage guarantee. The proposed algorithms are proven to ensure valid coverage and achieve sublinear regret. Experiments on real and synthetic datasets validate that the proposed methods construct smaller prediction sets and outperform existing multi-model online conformal prediction approaches.

在线学习共形预测图结构模型选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。