利用重叠区域客户端中继,加速多服务器联邦学习模型传播。
FedOC: Multi-Server FL with Overlapping Client Relays in Wireless Edge Networks
- 重叠区域客户端既作中继传递模型,又自主选择最优初始模型。
- 实验表明该方法显著提升训练速度,降低通信延迟。
- 适合对延迟敏感的边缘计算场景,如智能交通、工业物联网。
多服务器联邦学习(FL)已成为缓解单服务器模式通信瓶颈的有前景方案。本文聚焦于边缘服务器(ES)覆盖区域存在重叠的典型多服务器架构。观察到位于重叠区域的客户端可访问多个ES的边缘模型,据此提出FedOC(Federated learning with Overlapping Clients)框架,充分挖掘重叠客户端潜力。在FedOC中,重叠客户端可承担双重角色:(1)作为中继重叠客户端(ROCs),实时在相邻ES间转发边缘模型,促进不同ES间的模型共享;(2)作为正常重叠客户端(NOCs),根据边缘模型到达时间动态选择初始模型进行本地训练,实现跨区域间接数据融合。整体流程为:每轮中,各客户端基于最早接收到的边缘模型进行本地训练,并将结果上传至对应ES;各ES完成聚合后,通过ROC中继向邻近ES广播更新模型;接收后,各ES执行二次聚合并广播至覆盖客户端。ROC的存在使各ES模型能去中心化地扩散至其他ES,间接实现跨小区模型同步,加速训练过程,适用于低延迟敏感的边缘环境。大量实验表明,本方案相较现有方法性能显著提升。
原文摘要 · Abstract (English)
Multi-server Federated Learning (FL) has emerged as a promising solution to mitigate communication bottlenecks of single-server FL. We focus on a typical multi-server FL architecture, where the regions covered by different edge servers (ESs) may overlap. A key observation of this architecture is that clients located in the overlapping areas can access edge models from multiple ESs. Building on this insight, we propose FedOC (Federated learning with Overlapping Clients), a novel framework designed to fully exploit the potential of these overlapping clients. In FedOC, overlapping clients could serve dual roles: (1) as Relay Overlapping Clients (ROCs), they forward edge models between neighboring ESs in real time to facilitate model sharing among different ESs; and (2) as Normal Overlapping Clients (NOCs), they dynamically select their initial model for local training based on the edge model delivery time, which enables indirect data fusion among different regions of ESs. The overall FedOC workflow proceeds as follows: in every round, each client trains local model based on the earliest received edge model and transmits to the respective ESs for model aggregation. Then each ES transmits the aggregated edge model to neighboring ESs through ROC relaying. Upon receiving the relayed models, each ES performs a second aggregation and subsequently broadcasts the updated model to covered clients. The existence of ROCs enables the model of each ES to be disseminated to the other ESs in a decentralized manner, which indirectly achieves intercell model and speeding up the training process, making it well-suited for latency-sensitive edge environments. Extensive experimental results show remarkable performance gains of our scheme compared to existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。