arXiv:2509.08726math.OCcs.LG2025-09

提出新算法实现去中心化非凸优化的高效收敛,突破传统平滑性假设限制。

Decentralized Stochastic Nonconvex Optimization under the $(L_0,L_1)$-Smoothness

  • 设计基于梯度归一化的去中心化随机优化算法(DNSGD)
  • 在$(L_0,L_1)$-平滑条件下达到理论最优样本与通信复杂度
  • 适用于高梯度异质性的分布式学习场景

本文研究连通网络中$n$个智能体的去中心化随机优化问题,目标函数为$f(\mathbf{x})=\frac{1}{m}\sum_{i=1}^m f_i(\mathbf{x})$,其中每个局部函数$ f_i(\mathbf{x}) = {\mathbb E}\left[F(\mathbf{x};{\boldsymbol ξ}_i)\right]$满足$(L_0,L_1)$-平滑但可能非凸,且随机变量${\boldsymbol ξ}_i$服从分布${\mathcal D}_i$。提出一种新型算法——去中心化归一化随机梯度下降(DNSGD),可使各智能体达到$ε$-驻点。构建新的分析框架,基于梯度范数与一致性误差乘积的Lyapunov函数,证明该算法每智能体样本复杂度为${\mathcal O}(m^{-1}(L_fσ^2Δ_fε^{-4} + σ^2ε^{-2} + L_f^{-2}L_1^3σ^2Δ_fε^{-1} + L_f^{-2}L_1^2σ^2))$,通信复杂度为$\tilde{\mathcal O}((L_fε^{-2} + L_1ε^{-1})γ^{-1/2}Δ_f)$,其中$ L_f=L_0 +L_1ζ $,$σ^2$为随机梯度方差,$Δ_f$为初始函数值差距,$γ$为网络谱隙,$ζ$为梯度异质度。当$L_1=0$时,结果几乎逼近标准平滑条件下的下界。实验验证方法的优越性。

原文摘要 · Abstract (English)

This paper focuses on the decentralized stochastic optimization problem $f(\mathbf{x})=\frac{1}{m}\sum_{i=1}^m f_i(\mathbf{x})$ over a connected network of $n$ agents, where each local function has the form of $f_i(\mathbf{x}) = {\mathbb E}\left[F(\mathbf{x};{\boldsymbol ξ}_i)\right]$ which satisfies the $(L_0,L_1)$-smooth condition but possibly nonconvex and each random variable ${\boldsymbol ξ}_i$ follows distribution ${\mathcal D}_i$. We propose a novel algorithm called decentralized normalized stochastic gradient descent (DNSGD), which can achieve an $ε$-stationary point at each local agent. We present a new framework for analyzing decentralized first-order methods in the $(L_0,L_1)$-smooth setting, based on the Lyapunov function related to the product of the gradient norm and the consensus error. We show that the proposed algorithm attains the upper bounds on the sample complexity of ${\mathcal O}(m^{-1}(L_fσ^2Δ_fε^{-4} + σ^2ε^{-2} + L_f^{-2}L_1^3σ^2Δ_fε^{-1} + L_f^{-2}L_1^2σ^2))$ per agent and the communication complexity of $\tilde{\mathcal O}((L_fε^{-2} + L_1ε^{-1})γ^{-1/2}Δ_f)$, where $L_f=L_0 +L_1ζ$, $σ^2$ is the variance of the stochastic gradient, $Δ_f$ is the initial optimal function value gap, $γ$ is the spectral gap of the network, and $ζ$ is the degree of the gradient dissimilarity. In the special case of $L_1=0$, the above results (nearly) match the lower bounds of decentralized stochastic nonconvex optimization under the standard smoothness. We also conduct numerical experiments to show the empirical superiority of our method.

去中心化优化非凸优化随机梯度分布式学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。