arXiv:2609.04763cs.LGcs.DC2026-09

解决动态环境下客户端断联导致的模型偏差问题,提升联邦学习效率与公平性。

Resilience Beyond Stationary Client Unavailability: Unlocking Efficient and Unbiased Federated Learning

论文配图:Resilience Beyond Stationary Client Unavailability: Unlocking Efficient and Unbiased Federated Learning
图 1 · 摘自论文原文
  • 通过补偿缺失计算、扩散全局更新、隐式广播本地更新,实现对非平稳客户端可用性的鲁棒性。
  • 在真实数据集上验证,相比标准FedAvg,模型收敛更稳定且保持线性加速能力。
  • 轻量级设计适合资源受限的边缘设备,特别适合动态变化的现实联邦学习场景。

由于资源限制或内外部不确定性,现实联邦学习系统中的客户端往往是间歇性可用的边缘设备。在高度动态环境中,参数服务器无法实时获知客户端的可用性,使得传统联邦学习算法难以适应客户端可用性的不确定性。若不妥善处理,复杂的客户端可用性模式可能引入显著偏差,损害模型性能。现有研究或忽略非平稳的客户端可用性,或需要大量内存与计算开销。本文提出FedSWE算法,具备新颖的算法结构,能够(1)补偿缺失的计算,(2)在轮次间稳定并扩散全局更新,(3)通过隐式播送机制均衡混合本地更新,且无需依赖非平稳动态信息。相比标准FedAvg,FedSWE仅引入轻微额外内存与计算开销。我们证明,该算法在非凸目标下可收敛至平稳点,并在特定情况下实现期望的线性加速。我们在多种真实客户端不可用动态场景下,使用真实数据集进行数值实验,验证了理论分析的有效性。

原文摘要 · Abstract (English)

Due to resource constraints or external and internal uncertainties, clients in real-world federated learning systems are often intermittently available edge devices. In highly dynamic environments, the parameter server lacks prior real-time knowledge of clients' availability, making it challenging to adapt traditional federated learning algorithms to be resilient to uncertainties in client availability. If not carefully addressed, complex client availability can introduce significant bias, potentially harming the performance of the trained model. Most prior work either fails to account for non-stationary client availability dynamics or demands significant memory and computational overhead. This paper aims to develop efficient federated learning algorithms that are provably resilient to heterogeneous and non-stationary stochastic client availability. We propose FedSWE, which admits novel algorithmic structures to (i) compensate for missed computations, (ii) stabilize and diffuse the global updates over rounds, and (iii) evenly mix the local updates through implicit gossiping, despite being agnostic to non-stationary dynamics. Compared with the standard FedAvg, FedSWE introduces light additional memory and computation overhead. We show that FedSWE converges to a stationary point of non-convex objectives while achieving the desired linear speedup property in certain special cases. We corroborate our analysis with numerical experiments over diversified client unavailability dynamics on real-world data sets.

联邦学习边缘计算鲁棒性非平稳性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。