arXiv:2505.05099cs.LGcs.IT2025-05被引 2

用信息年龄优化客户端参与,提升联邦学习公平性与收敛速度

Balancing Client Participation in Federated Learning Using AoI

  • 基于信息年龄设计去中心化调度策略,按更新时效动态选参
  • 在非独立同分布数据下比FedAvg快20%,独立同分布下快7.5%
  • 适合追求高效公平的分布式训练系统部署

联邦学习(FL)提供了一种去中心化的框架,在保护数据隐私的同时实现跨分布式客户端的协作模型训练。然而,受限于通信资源、统计异质性以及客户端参与不均衡等问题,FL面临显著挑战。本文提出一种基于信息年龄(AoI)的客户端选择策略,通过控制选择间隔来最小化负载不均。该方法采用去中心化的马尔可夫调度策略,使客户端根据更新年龄自适应决定参与概率,从而在极少中央干预下实现各轮训练中客户端更新的均衡分布。我们给出了该方法的收敛性证明,表明其能确保稳定高效的模型收敛。具体地,推导出马尔可夫选择模型的最优参数,以实现平衡且一致的客户端参与,凸显了AoI在提升收敛稳定性方面的优势。大量仿真表明,所提出的基于AoI的方法,尤其是最优马尔可夫变体,在独立同分布(IID)和非独立同分布(non-IID)数据设置下,相比FedAvg选择策略分别提升了7.5%和最高达20%的收敛性能。研究结果验证了基于AoI的调度在多样化学习环境中对可扩展、公平且高效的联邦学习系统的有效性。

原文摘要 · Abstract (English)

Federated Learning (FL) offers a decentralized framework that preserves data privacy while enabling collaborative model training across distributed clients. However, FL faces significant challenges due to limited communication resources, statistical heterogeneity, and the need for balanced client participation. This paper proposes an Age of Information (AoI)-based client selection policy that addresses these challenges by minimizing load imbalance through controlled selection intervals. Our method employs a decentralized Markov scheduling policy, allowing clients to independently manage participation based on age-dependent selection probabilities, which balances client updates across training rounds with minimal central oversight. We provide a convergence proof for our method, demonstrating that it ensures stable and efficient model convergence. Specifically, we derive optimal parameters for the Markov selection model to achieve balanced and consistent client participation, highlighting the benefits of AoI in enhancing convergence stability. Through extensive simulations, we demonstrate that our AoI-based method, particularly the optimal Markov variant, improves convergence over the FedAvg selection approach across both IID and non-IID data settings by $7.5\%$ and up to $20\%$. Our findings underscore the effectiveness of AoI-based scheduling for scalable, fair, and efficient FL systems across diverse learning environments.

联邦学习调度优化信息年龄去中心化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。