arXiv:2410.17336cs.LGcs.DS2024-10被引 3

自动计算最优正则化项,让在线学习算法更高效。

Computing Optimal Regularizers for Online Linear Optimization

  • 根据动作集和损失集,计算出使后悔值接近理论最优的正则化项。
  • 在任意对称凸集中,可实现与最优算法相差常数因子的后悔值。
  • 适用于高维在线优化,但需预处理;适合研究最优算法边界的研究者。

在线线性优化(OLO)中的跟随正则化领导者(FTRL)算法能保证次线性后悔值,但正则化项的选择显著影响维度相关的后悔界。本文提出一种算法,输入特定OLO实例的凸对称动作集和损失集,输出一个正则化项,使得使用该正则化项运行FTRL时,其后悔值在常数因子内逼近最优可能后悔值。特别地,对任意凸对称动作集和损失集,均存在一种FTRL实现,其后悔值与最优学习算法相差常数因子,强化了Srebro等(2011)的普适性结果。该算法预处理时间和空间为维度d的指数级,但若具备动作集和损失集的成员判断与线性优化预言机,可在在线阶段高效运行(常数维度下为多项式时间)。此外,我们证明:判断给定正则化项是否相对于某范数为α-强凸,是NP难问题。

原文摘要 · Abstract (English)

Follow-the-Regularized-Leader (FTRL) algorithms are a popular class of learning algorithms for online linear optimization (OLO) that guarantee sub-linear regret, but the choice of regularizer can significantly impact dimension-dependent factors in the regret bound. We present an algorithm that takes as input convex and symmetric action sets and loss sets for a specific OLO instance, and outputs a regularizer such that running FTRL with this regularizer guarantees regret within a universal constant factor of the best possible regret bound. In particular, for any choice of (convex, symmetric) action set and loss set we prove that there exists an instantiation of FTRL which achieves regret within a constant factor of the best possible learning algorithm, strengthening the universality result of Srebro et al., 2011. Our algorithm requires preprocessing time and space exponential in the dimension $d$ of the OLO instance, but can be run efficiently online assuming a membership and linear optimization oracle for the action and loss sets, respectively (and is fully polynomial time for the case of constant dimension $d$). We complement this with a lower bound showing that even deciding whether a given regularizer is $α$-strongly-convex with respect to a given norm is NP-hard.

在线学习正则化后悔界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。