arXiv:2510.02820cs.LGcs.DS2025-10ICML被引 3

将随机顺序下的在线学习算法改进,提升有限时间表现。

Online Learning in the Random Order Model

  • 提出通用模板,适配随机顺序的在线学习
  • 在有限时间下显著改善预测延迟等场景的误差
  • 证明随机顺序下可学习性由VC维决定

在随机顺序模型中,损失序列由对手事先确定,随后以随机排列呈现给学习者。尽管任意随机顺序输入在渐近意义下等价于独立同分布的随机情形,但在有限时间内可能表现出显著的非平稳性,从而影响随机学习算法的表现。虽然对抗性输入下的算法自然保持其后悔界,但简单的无后悔随机算法在随机顺序实例上会失效。本文提出一种通用模板,可将随机学习算法适配到随机顺序模型,几乎不损害其后悔界。由此我们恢复了预测延迟、带约束在线学习和带切换成本的多臂赌博机问题的改进后悔界。最后,我们研究在线分类问题,证明在随机顺序下,可学习性由VC维而非Littlestone维刻画,进一步区分了该模型与一般对抗模型。

原文摘要 · Abstract (English)

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic i.i.d. one, but, for finite times, it may exhibit significant {\em non-stationarity}, which can hinder the performance of stochastic learning algorithms. While algorithms for adversarial inputs naturally maintain their regret guarantees in random order, simple no-regret algorithms exist for the stochastic model that fail against random-order instances. In this paper, we propose a general template to adapt stochastic learning algorithms to the random-order model without substantially affecting their regret guarantees. This allows us to recover improved regret bounds for prediction with delays, online learning with constraints, and bandits with switching costs. Finally, we investigate online classification and prove that, in random order, learnability is characterized by the VC dimension rather than the Littlestone dimension, thus providing a further separation from the general adversarial model.

在线学习随机顺序后悔界VC维

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。