用李雅普诺夫函数简洁证明了加速梯度法的收敛速度
A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method
- 基于李雅普诺夫函数构建统一分析框架
- 严格推导出凸与强凸函数下的收敛速率
- 为理解加速机制提供清晰理论依据
Nesterov加速梯度法的收敛性分析在过去几十年中受到广泛关注。尽管已有大量工作探讨其理论性质并阐明加速背后的直觉，但其收敛速率仍缺乏简洁直接的证明。本文为一般凸和强凸函数情形下Nesterov加速梯度法的收敛速率提供了简洁的李雅普诺夫分析。
原文摘要 · Abstract (English)
Convergence analysis of Nesterov's accelerated gradient method has attracted significant attention over the past decades. While extensive work has explored its theoretical properties and elucidated the intuition behind its acceleration, a simple and direct proof of its convergence rates is still lacking. We provide a concise Lyapunov analysis of the convergence rates of Nesterov's accelerated gradient method for both general convex and strongly convex functions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。