用斯坦因方法设计高效在线线性优化算法,实现最优性能权衡。
Operationalizing Stein's Method for Online Linear Optimization: CLT-Based Optimal Tradeoffs
- 基于斯坦因方法构造可计算的在线优化算法
- 性能上界与正态近似下界仅差低阶项,逼近理论最优
- 适用于无参数学习、噪声反馈等场景,优于传统方法
对抗性在线线性优化(OLO)本质上是针对未知对手难度进行性能权衡。在有界域上的一维固定时间OLO中,自Cover(1966)以来已知可达成的权衡由概率不等式决定,这些描述性结果可通过动态规划转化为算法,但计算效率低。本文提出将斯坦因方法——一种经典概率极限定理证明框架——转化为计算高效的OLO算法。其对应的后悔值和总损失上界为“加法意义最优”,即超越传统大O最优性,与基于正态近似的下界仅相差低阶项。该构造受Röllin(2018)关于Wasserstein鞅中心极限定理的简洁证明启发。具体优势包括:相同计算复杂度下,优于在线梯度下降(OGD)和乘法权重更新(MWU)的总损失上界;可实现总损失与最大后悔值之间的连续最优二点权衡,改进无参在线学习;允许对手在无界支持上随机化,获得带噪声反馈时期望性能的精确保证。
原文摘要 · Abstract (English)
Adversarial online linear optimization (OLO) is essentially about making performance tradeoffs with respect to the unknown difficulty of the adversary. In the setting of one-dimensional fixed-time OLO on a bounded domain, it has been observed since Cover (1966) that achievable tradeoffs are governed by probabilistic inequalities, and these descriptive results can be converted into algorithms via dynamic programming, which, however, is not computationally efficient. We address this limitation by showing that Stein's method, a classical framework underlying the proofs of probabilistic limit theorems, can be operationalized as computationally efficient OLO algorithms. The associated regret and total loss upper bounds are "additively sharp", meaning that they surpass the conventional big-O optimality and match normal-approximation-based lower bounds by additive lower order terms. Our construction is inspired by the remarkably clean proof of a Wasserstein martingale central limit theorem (CLT) due to Röllin (2018). Several concrete benefits can be obtained from this general technique. First, with the same computational complexity, the proposed algorithm improves upon the total loss upper bounds of online gradient descent (OGD) and multiplicative weight update (MWU). Second, our algorithm can realize a continuum of optimal two-point tradeoffs between the total loss and the maximum regret over comparators, improving upon prior works in parameter-free online learning. Third, by allowing the adversary to randomize on an unbounded support, we achieve sharp in-expectation performance guarantees for OLO with noisy feedback.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。