老算法搞定重尾噪声下的在线优化,无需修改就达最优效果
Online Convex Optimization with Heavy Tails: Old Algorithms, New Regrets, and Applications
- 用经典算法处理梯度有重尾的情况,不需改动
- 在p∈(1,2]时实现理论最优后悔值
- 适合重尾噪声下非凸优化问题的分析与应用
在在线凸优化(OCO)中,当随机梯度具有有限方差时,许多算法可保证次线性后悔。然而,当梯度估计具有重尾特性(即仅存在有限的p阶中心矩,p∈(1,2])时,现有结果仍有限。本文研究经典算法(如在线梯度下降)在更困难的重尾设定下的表现。在标准有界域假设下,我们建立了无需任何算法修改的新后悔界。值得注意的是,这些后悔界在所有参数上均为最优(甚至无需预先知道p),表明重尾情形下的OCO可通过原算法有效解决,无需额外操作(如梯度裁剪)。新结果具有多个应用,尤其首次实现了在无梯度裁剪条件下,非光滑非凸优化于重尾噪声下的可证明且最优收敛。此外,我们拓展思路至更广设置(如光滑OCO),并应用于乐观型算法以统一处理多种情形。
原文摘要 · Abstract (English)
In Online Convex Optimization (OCO), when the stochastic gradient has a finite variance, many algorithms provably work and guarantee a sublinear regret. However, limited results are known if the gradient estimate has a heavy tail, i.e., the stochastic gradient only admits a finite $\mathsf{p}$-th central moment for some $\mathsf{p}\in\left(1,2\right]$. Motivated by it, this work examines different old algorithms for OCO (e.g., Online Gradient Descent) in the more challenging heavy-tailed setting. Under the standard bounded domain assumption, we establish new regrets for these classical methods without any algorithmic modification. Remarkably, these regret bounds are fully optimal in all parameters (can be achieved even without knowing $\mathsf{p}$), suggesting that OCO with heavy tails can be solved effectively without any extra operation (e.g., gradient clipping). Our new results have several applications. A particularly interesting one is the first provable and optimal convergence result for nonsmooth nonconvex optimization under heavy-tailed noise without gradient clipping. Furthermore, we explore broader settings (e.g., smooth OCO) and extend our ideas to optimistic algorithms to handle different cases simultaneously.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。