负步长让梯度下降-上升法收敛,打破传统认知。
Negative Stepsizes Make Gradient-Descent-Ascent Converge
- 设计时变、非对称、周期性负步长的新型调度策略。
- 在经典反例上实现快速收敛,克服了原GDA的循环问题。
- 适合研究优化算法、生成对抗网络训练的学者参考。
高效求解极小-极大问题在优化、学习、博弈和控制中至关重要。最自然的算法是梯度下降-上升(GDA),但自1970年代以来,普遍认为其在简单问题上无法收敛,这促使大量研究引入外梯度、乐观性、动量、锚定等改进。本文证明,仅通过合理选择步长,原版GDA即可收敛。核心创新是提出非常规步长调度(称为弹射步长),具有时间变化、不对称和周期性负值三个特性。我们证明三者缺一不可,并使GDA在经典反例(如无约束凸-凹问题)上收敛。其机制在于:负步长虽为后退,却打破极小与极大变量的同步性,引发‘弹射’效应——后续正向迭代的进展远超前序回退,整体加速收敛。几何上,该动态利用梯度流的不可逆性:正负步长一阶抵消,产生二阶净位移,导向新方向,实现原GDA无法达到的收敛。该方法可视为二阶有限差分算法,且意外近似实现了共识优化,这是深度神经网络中极小-极大问题(如训练GAN)的流行方法。
原文摘要 · Abstract (English)
Efficient computation of min-max problems is a central question in optimization, learning, games, and control. Arguably the most natural algorithm is gradient-descent-ascent (GDA). However, since the 1970s, conventional wisdom has argued that GDA fails to converge even on simple problems. This failure spurred an extensive literature on modifying GDA with additional building blocks such as extragradients, optimism, momentum, anchoring, etc. In contrast, we show that GDA converges in its original form by simply using a judicious choice of stepsizes. The key innovation is the proposal of unconventional stepsize schedules (dubbed slingshot stepsize schedules) that are time-varying, asymmetric, and periodically negative. We show that all three properties are necessary for convergence, and that altogether this enables GDA to converge on the classical counterexamples (e.g., unconstrained convex-concave problems). The core algorithmic intuition is that although negative stepsizes make backward progress, they de-synchronize the min and max variables (overcoming the cycling issue of GDA), and lead to a slingshot phenomenon in which the forward progress in the other iterations is overwhelmingly larger. This results in fast overall convergence. Geometrically, the slingshot dynamics leverage the non-reversibility of gradient flow: positive/negative steps cancel to first order, yielding a second-order net movement in a new direction that leads to convergence and is otherwise impossible for GDA to move in. We interpret this as a second-order finite-differencing algorithm and show that, intriguingly, it approximately implements consensus optimization, an empirically popular algorithm for min-max problems involving deep neural networks (e.g., training GANs).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。