arXiv:2601.07901stat.MLcs.AI2026-01AAAI被引 2

解决分布式在线优化中未知延迟问题,提升学习效率与稳定性。

Decentralized Online Convex Optimization with Unknown Feedback Delays

  • 提出自适应学习率机制,无需先验延迟知识即可本地估计延迟。
  • 理论证明在非强凸下达到最优阶的损失界,强凸下更优且紧致。
  • 适合联邦学习、传感器网络等存在异步通信的分布式系统应用。

去中心化在线凸优化(D-OCO)在联邦学习、传感器网络和多智能体控制等场景中具有自然应用。本文研究在未知、时变且跨智能体变化的反馈延迟下的D-OCO问题。尽管近期工作(Nguyen et al., 2024)已处理该问题,但现有算法需预先知晓总延迟,且对延迟与网络参数的依赖仍非最优。为此,我们提出一种新算法,实现改进的遗憾上界:O(N√d_tot + N√T(1−σ²)^{1/4}),其中T为总时长,d_tot为各智能体平均总延迟,N为智能体数,1−σ²为网络谱间隙。方法基于最新进展(Wan et al., 2024a),关键引入基于共识的去中心化通信协议,使每个智能体通过广播策略本地估计延迟,无需提前知晓总延迟。进一步将框架扩展至强凸情形,导出更紧的遗憾上界:O(Nδ_max ln T / α),其中α为强凸参数,δ_max为各智能体平均缺失观测最大值。实验验证了方法有效性,优于现有基准算法。

原文摘要 · Abstract (English)

Decentralized online convex optimization (D-OCO), where multiple agents within a network collaboratively learn optimal decisions in real-time, arises naturally in applications such as federated learning, sensor networks, and multi-agent control. In this paper, we study D-OCO under unknown, time-and agent-varying feedback delays. While recent work has addressed this problem (Nguyen et al., 2024), existing algorithms assume prior knowledge of the total delay over agents and still suffer from suboptimal dependence on both the delay and network parameters. To overcome these limitations, we propose a novel algorithm that achieves an improved regret bound of O N $\sqrt$ d tot + N $\sqrt$ T (1-$σ$2) 1/4 , where T is the total horizon, d tot denotes the average total delay across agents, N is the number of agents, and 1 -$σ$ 2 is the spectral gap of the network. Our approach builds upon recent advances in D-OCO (Wan et al., 2024a), but crucially incorporates an adaptive learning rate mechanism via a decentralized communication protocol. This enables each agent to estimate delays locally using a gossip-based strategy without the prior knowledge of the total delay. We further extend our framework to the strongly convex setting and derive a sharper regret bound of O N $δ$max ln T $α$ , where $α$ is the strong convexity parameter and $δ$ max is the maximum number of missing observations averaged over agents. We also show that our upper bounds for both settings are tight up to logarithmic factors. Experimental results validate the effectiveness of our approach, showing improvements over existing benchmark algorithms.

分布式优化在线学习延迟鲁棒联邦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。