arXiv:2505.21460cs.LGcs.DS2025-05NeurIPS被引 15

无需复杂调参,用新算法实现高维预测校准。

High-Dimensional Calibration from Swap Regret

  • 基于交换后悔最小化,统一处理任意凸集和范数的校准问题。
  • 在单纯形上实现ε-校准仅需exp(~O(log d/ε²))轮,比前人更优。
  • 算法高效简洁,适合对预测可靠性要求高的场景。

我们研究在任意凸集 $P \subset \mathbb{R}^d$ 上相对于任意范数 $|\cdot|$ 的多维预测在线校准问题。通过将该问题与在线线性优化(OLO)的外部后悔最小化相联系:若能在 $T$ 轮中保证动作来自 $P$、损失来自对偶范数单位球时,最坏情况后悔为 $O(\sqrt{ρT})$,则可在 $T = \exp(\tilde O(ρ/ε^2))$ 轮后获得 $ε$-校准预测。当 $P$ 为 $d$ 维单纯形且 $|\cdot|$ 为 $\ell_1$-范数时,利用 $O(\sqrt{T\log d})$ 的专家后悔界,可得 $T = \exp(\tilde O(\log d/ε^2)) = d^{\tilde O(1/ε^2)}$ 轮内实现 $ε$-校准,恢复了 Peng (2025) 的结果。有趣的是,我们的算法不依赖任何在线线性优化子程序或最优率 $ρ$ 的知识——实际上对所有 $P$ 与 $|\cdot|$ 设置都相同。我们证明,上述 OLO 问题的最优正则化项可将校准误差上界表示为交换后悔,并通过最近的 TreeSwap 算法(Dagan et al., 2024; Peng and Rubinstein, 2024)以跟随领导者为子程序进行最小化。最终算法高度高效,每轮仅在历史观测的简单平均分布上采样。最后,我们证明:任何保证在 $d$ 维单纯形上 $εT$ 次 $\ell_1$-校准误差的在线校准算法,均需满足 $T \geq \exp(\mathrm{poly}(1/ε))$(假设 $d \geq \mathrm{poly}(1/ε)$)。这强化了 Peng (2025) 的 $d^{Ω(\log(1/ε))}$ 下界,表明 $1/ε$ 的指数依赖是必需的。

原文摘要 · Abstract (English)

We study online calibration of multi-dimensional forecasts over an arbitrary convex set $P \subset \mathbb{R}^d$ relative to an arbitrary norm $|\cdot|$. We connect this to external regret minimization for online linear optimization (OLO): if one can guarantee $O(\sqrt{ρT})$ worst-case regret after $T$ rounds when actions are drawn from $P$ and losses from the dual $|\cdot|_*$ unit norm ball, then one can obtain $ε$-calibrated forecasts after $T = \exp(\tilde O(ρ/ε^2))$ rounds. When $P$ is the $d$-dimensional simplex and $|\cdot|$ is the $\ell_1$-norm, the $O(\sqrt{T\log d})$ experts regret bound yields $ε$-calibrated forecasts after $T = \exp(\tilde O(\log d/ε^2)) = d^{\tilde O(1/ε^2)}$ rounds, recovering a recent result of Peng (2025). Interestingly, our algorithm obtains this guarantee without requiring access to any online linear optimization subroutine or knowledge of the optimal rate $ρ$ -- in fact, our algorithm is identical for every setting of $P$ and $|\cdot|$. Instead, we show that the optimal regularizer for the above OLO problem can be used to upper bound the above calibration error by a swap regret, which we then minimize by running the recent TreeSwap algorithm (Dagan et al., 2024; Peng and Rubinstein, 2024) with Follow-The-Leader as a subroutine. The resulting algorithm is highly efficient and plays a distribution over simple averages of past observations in each round. Finally, we prove that any online calibration algorithm that guarantees $εT$ $\ell_1$-calibration error over the $d$-dimensional simplex requires $T \geq \exp(\mathrm{poly}(1/ε))$ (assuming $d \geq \mathrm{poly}(1/ε)$). This strengthens the corresponding $d^{Ω(\log(1/ε))}$ lower bound of Peng (2025), and shows that an exponential dependence on $1/ε$ is necessary.

在线学习校准后悔最小化高维

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。