arXiv:2502.09303cs.LGcs.DC2025-02被引 4

针对设备间歇参与,提出分阶段客户端选择方法以降低系统开销。

Towards Seamless Hierarchical Federated Learning under Intermittent Client Participation: A Stagewise Decision-Making Methodology

  • 分两阶段决策:先选长期可用客户端,再备选临时替代者
  • 在MNIST和CIFAR-10上实现更低延迟与能耗,且收敛更快
  • 适合真实场景中设备频繁离线的联邦学习系统

联邦学习(FL)允许多个客户端在不共享数据的前提下协作训练全局模型,但频繁通信导致高延迟、高能耗和回传链路拥塞。为缓解此问题,分层联邦学习(HFL)通过边缘节点聚合客户端本地模型,降低中心服务器负担。现有研究多关注固定客户端集下的性能优化,而对实际中客户端动态可用性问题关注不足。本文研究在客户端间歇参与条件下,如何通过优化客户端选择与边端关联来最小化系统总成本(延迟与能耗),同时保证快速模型收敛。我们发现该问题是复杂NP-hard问题。为此提出分阶段方法:第一阶段(Plan A)识别未来训练轮次中高参与概率的长期客户端;第二阶段(Plan B)在长期客户端不可用时启用备选客户端。该方法提升了决策效率,在MNIST和CIFAR-10数据集上的实验表明,相比现有基准,本方法在模型精度与系统开销方面均有显著提升。

原文摘要 · Abstract (English)

Federated Learning (FL) offers a pioneering distributed learning paradigm that enables devices/clients to build a shared global model. This global model is obtained through frequent model transmissions between clients and a central server, which may cause high latency, energy consumption, and congestion over backhaul links. To overcome these drawbacks, Hierarchical Federated Learning (HFL) has emerged, which organizes clients into multiple clusters and utilizes edge nodes (e.g., edge servers) for intermediate model aggregations between clients and the central server. Current research on HFL mainly focus on enhancing model accuracy, latency, and energy consumption in scenarios with a stable/fixed set of clients. However, addressing the dynamic availability of clients -- a critical aspect of real-world scenarios -- remains underexplored. This study delves into optimizing client selection and client-to-edge associations in HFL under intermittent client participation so as to minimize overall system costs (i.e., delay and energy), while achieving fast model convergence. We unveil that achieving this goal involves solving a complex NP-hard problem. To tackle this, we propose a stagewise methodology that splits the solution into two stages, referred to as Plan A and Plan B. Plan A focuses on identifying long-term clients with high chance of participation in subsequent model training rounds. Plan B serves as a backup, selecting alternative clients when long-term clients are unavailable during model training rounds. This stagewise methodology offers a fresh perspective on client selection that can enhance both HFL and conventional FL via enabling low-overhead decision-making processes. Through evaluations on MNIST and CIFAR-10 datasets, we show that our methodology outperforms existing benchmarks in terms of model accuracy and system costs.

联邦学习边缘计算客户端选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。