arXiv:2604.19336cs.LGmath.OC2026-04

提出新框架让联邦在线学习实现并行化收益,突破传统限制。

FedSEA: Achieving Benefit of Parallelization in Federated Online Learning

论文配图:FedSEA: Achieving Benefit of Parallelization in Federated Online Learning
图 1 · 摘自论文原文
  • 引入随机扩展对手模型,动态调整客户端数据分布。
  • 证明平滑凸损失下网络遗憾为O(√T),强凸下为O(log T)。
  • 发现温和时间变化时并行可降低遗憾,适合高异构场景研究者。

在线联邦学习(OFL)已成为在不牺牲客户端隐私的前提下,对持续数据流进行去中心化决策的流行框架。然而,标准OFL假设的对抗模型通常排除了并行化的潜在优势,且未能充分捕捉OFL问题中统计变异的不同来源。本文通过引入随机扩展对手(SEA)扩展了OFL范式:损失函数在客户端间保持不变,但对手在每个时间步独立地动态选择各客户端的数据分布。我们提出了 exttt{FedSEA}算法,客户端采用在线随机梯度下降,服务器周期性执行全局聚合。我们建立了时间跨度$T$下的全局网络遗憾界:对于光滑凸损失,证明了$igO( oot{T})$界;对于光滑强凸损失,证明了$igO( ext{log} hinspace T)$界。通过细致分析,量化了空间(跨客户端)和时间(随时间)数据异构性对遗憾界的影响。结果表明,在时间变化相对小于随机梯度方差的温和条件下,并行化能改善网络遗憾。因此,在SEA设定下,我们的结果改进了现有在线联邦学习的悲观最坏情况结果。

原文摘要 · Abstract (English)

Online federated learning (OFL) has emerged as a popular framework for decentralized decision-making over continuous data streams without compromising client privacy. However, the adversary model assumed in standard OFL typically precludes any potential benefits of parallelization. Further, it fails to adequately capture the different sources of statistical variation in OFL problems. In this paper, we extend the OFL paradigm by integrating a stochastically extended adversary (SEA). Under this framework, the loss function remains fixed across clients over time. However, the adversary dynamically and independently selects the data distribution for each client at each time. We propose the \algoOFL{} algorithm to solve this problem, which utilizes online stochastic gradient descent at the clients, along with periodic global aggregation via the server. We establish bounds on the global network regret over a time horizon \(T\) for two classes of functions: (1) for smooth and convex losses, we prove an \(\mathcal{O}(\sqrt{T})\) bound, and (2) for smooth and strongly convex losses, we prove an \(\mathcal{O}(\log T)\) bound. Through careful analysis, we quantify the individual impact of both spatial (across clients) and temporal (over time) data heterogeneity on the regret bounds. Consequently, we identify a regime of mild temporal variation (relative to stochastic gradient variance), where the network regret improves with parallelization. Hence, in the SEA setting, our results improve the existing pessimistic worst-case results in online federated learning.

联邦学习在线学习并行优化遗憾界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。