将在线学习转化为多校准,实现高效鲁棒的预测算法
An Efficient Black-Box Reduction from Online Learning to Multicalibration, and a New Route to $Φ$-Regret Minimization
- 用任意无遗憾学习器搭配期望变分不等式求解器,实现高维多校准
- 首次在全情况下实现√T量级的多校准保证,突破原有理论瓶颈
- 适用于延迟反馈、删失数据等复杂场景,适合研究公平性与稳健预测者
我们给出一个类GGM的黑箱归约,将在线学习转化为在线多校准。具体而言,要实现对函数类$$\mathcal{H}$$的高维多校准,只需将任意无遗憾学习器与期望变分不等式(EVI)求解器结合。我们还证明了逆命题:高效的多校准可推出高效的EVI求解,凸显多校准中EVI与Φ-遗憾中的不动点之间的类比关系。这一结果解决了Garg, Jung, Reingold, Roth(SODA '24)提出的开放问题,首次在全情况下实现了√T量级的口令高效在线多校准。此外,我们的归约统一了现有算法分析,可将在线学习的保证转移到存在延迟观测或删失结果的复杂环境,并首次实现从在线学习到多分类全能预测的高效黑箱归约。第二项主要成果是将高维在线多校准细粒度归约为(上下文)Φ-遗憾最小化。结合第一项结果,建立了一条绕过复杂不动点或半分离技术的新路径,显著简化了Daskalakis et al.(STOC '25)的结果并改进了收敛速率,同时得到了对更丰富偏差类(如再生核希尔伯特空间中类)具有鲁棒性的新算法。
原文摘要 · Abstract (English)
We give a Gordon-Greenwald-Marks (GGM) style black-box reduction from online learning to online multicalibration. Concretely, we show that to achieve high-dimensional multicalibration with respect to a class of functions $\mathcal{H}$, it suffices to combine any no-regret learner over $\mathcal {H} $ with an expected variational inequality (EVI) solver. We also prove a converse statement showing that efficient multicalibration implies efficient EVI solving, highlighting how EVIs in multicalibration mirror the role of fixed points in the GGM result for $Φ$-regret. This first set of results addresses the high-dimensional analogue of the open question in Garg, Jung, Reingold, and Roth (SODA '24), showing that oracle-efficient online multicalibration with $\sqrt{T}$-type guarantees is possible in full generality. Furthermore, our GGM-style reduction unifies the analyses of existing algorithms, transfers guarantees from online learning to multicalibration for challenging environments with delayed observations or censored outcomes, and yields the first efficient black-box reduction between online learning and multiclass omniprediction. Our second main result is a fine-grained reduction from high-dimensional online multicalibration to (contextual) $Φ$-regret minimization. Together with our first result, this establishes a new route from external regret to $Φ$-regret that bypasses sophisticated fixed-point or semi-separation machinery, dramatically simplifies a result of Daskalakis, Farina, Fishelson, Pipis, and Schneider (STOC '25) while improving rates, and yields new algorithms that are robust to richer deviation classes, such as those belonging to any reproducing kernel Hilbert space.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。