arXiv:2412.17231cs.LGcs.IT2024-12中稿 · IEEE Transactions …被引 10

利用卫星移动特性实现全球联邦学习,降低通信开销与延迟。

FedMeld: A Model-dispersal Federated Learning Framework for Space-ground Integrated Networks

  • 通过卫星周期性移动和存储转发机制分散模型参数,无需地面站或星间链路。
  • 理论证明可全局收敛,优化轮次间隔与混合比例使精度与延迟达到最优平衡。
  • 适合资源受限的广域物联网场景,尤其适用于无基础设施覆盖区域。

为弥合数字鸿沟,空地一体化网络(SGINs)有望将人工智能服务普及至全球各地。其关键任务之一是在全球范围内支持联邦学习(FL)。然而,现有空地一体化联邦学习框架依赖地面站或昂贵的星间链路,导致训练延迟高、通信成本大。为此,我们提出一种无基础设施的联邦学习框架 FedMeld,基于模型分散策略,利用卫星的周期性运动模式和存储-携带-转发能力,在大规模地理区域间实现参数混合。理论分析表明,FedMeld 可实现全局模型收敛,并量化了轮次间隔与相邻区域混合比例对学习性能的影响。基于此,我们构建联合优化问题以设计稳定性控制与混合比例(SC-MR),最小化训练损失。通过分解为顺序的 SC 与 MR 子问题,不牺牲最优性,推导出轮次间隔的闭式解和混合比例的半闭式解,实现最优延迟-精度权衡。在多个数据集上的实验表明,相比传统方案,FedMeld 在显著降低通信成本的同时,仍保持更优的模型准确率。

原文摘要 · Abstract (English)

To bridge the digital divide, space-ground integrated networks (SGINs) are expected to deliver artificial intelligence (AI) services to every corner of the world. One key mission of SGINs is to support federated learning (FL) at a global scale. However, existing space-ground integrated FL frameworks involve ground stations or costly inter-satellite links, entailing excessive training latency and communication costs. To overcome these limitations, we propose an infrastructure-free federated learning framework based on a model dispersal (FedMeld) strategy, which exploits periodic movement patterns and store-carry-forward capabilities of satellites to enable parameter mixing across large-scale geographical regions. We theoretically show that FedMeld leads to global model convergence and quantify the effects of round interval and mixing ratio between adjacent areas on its learning performance. Based on the theoretical results, we formulate a joint optimization problem to design the staleness control and mixing ratio (SC-MR) for minimizing the training loss. By decomposing the problem into sequential SC and MR subproblems without compromising the optimality, we derive the round interval solution in a closed form and the mixing ratio in a semi-closed form to achieve the optimal latency-accuracy tradeoff. Experiments using various datasets demonstrate that FedMeld achieves superior model accuracy while significantly reducing communication costs as compared with traditional FL schemes for SGINs.

联邦学习空地融合卫星网络模型分散

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。