用卫星网络提升异构设备的联邦学习效率,解决带宽不足与设备差异难题。
SatFed: A Resource-Efficient LEO Satellite-Assisted Heterogeneous Federated Learning Framework
- 基于模型新鲜度排队,优先传输关键模型,节省有限卫星带宽。
- 构建多图结构捕捉设备间数据、带宽、算力差异,实现精准聚合。
- 适用于资源受限的卫星通信场景,尤其适合偏远地区异构设备协同训练。
传统联邦学习依赖地面网络,覆盖范围有限且带宽日益拥堵,严重制约模型收敛。低地球轨道(LEO)卫星网络的发展为补充地面通信提供了新路径。然而,卫星-地面链路带宽有限,加之地面设备在数据分布、带宽和计算能力上的异构性,给高效可靠的卫星辅助联邦学习带来挑战。为此,本文提出SatFed,一种资源高效的卫星辅助异构联邦学习框架。SatFed采用基于新鲜度的模型优先级队列,优化极受限的卫星-地面带宽使用,确保最关键模型得以传输。同时,构建多图以实时捕捉设备间的异构关系,包括数据分布、地面带宽和计算能力。该多图支持将卫星传输的模型转化为同伴指导,增强异构环境下的本地训练效果。在真实LEO卫星网络上的大量实验表明,SatFed相比现有最优基准展现出更优性能与鲁棒性。
原文摘要 · Abstract (English)
Traditional federated learning (FL) frameworks rely heavily on terrestrial networks, where coverage limitations and increasing bandwidth congestion significantly hinder model convergence. Fortunately, the advancement of low-Earth orbit (LEO) satellite networks offers promising new communication avenues to augment traditional terrestrial FL. Despite this potential, the limited satellite-ground communication bandwidth and the heterogeneous operating environments of ground devices-including variations in data, bandwidth, and computing power-pose substantial challenges for effective and robust satellite-assisted FL. To address these challenges, we propose SatFed, a resource-efficient satellite-assisted heterogeneous FL framework. SatFed implements freshness-based model prioritization queues to optimize the use of highly constrained satellite-ground bandwidth, ensuring the transmission of the most critical models. Additionally, a multigraph is constructed to capture real-time heterogeneous relationships between devices, including data distribution, terrestrial bandwidth, and computing capability. This multigraph enables SatFed to aggregate satellite-transmitted models into peer guidance, enhancing local training in heterogeneous environments. Extensive experiments with real-world LEO satellite networks demonstrate that SatFed achieves superior performance and robustness compared to state-of-the-art benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。