用最小生成树优化卫星联邦学习,提升效率与稳定性
Graph Theory Meets Federated Learning over Satellite Constellations: Spanning Aggregations, Network Formation, and Performance Optimization
- 基于最小生成树构建卫星间模型聚合拓扑
- 收敛速度更快,能耗降低32%,延迟减少41%
- 适合大规模低轨卫星网络的分布式学习场景
本文提出Fed-Span:一种面向低地球轨道(LEO)卫星星座的联邦学习框架,解决卫星网络中连接间歇、计算能力异构及数据分布动态变化等关键挑战。通过引入最小生成树(MST)与最小生成森林(MSF)拓扑结构,实现模型聚合与任务分发。我们以连续约束表示(CCRs)形式建模这些拓扑,将其融入分布式学习框架,并量化了操作的能耗与延迟。同时推导出适用于系统特性的新型收敛边界,涵盖可调参数带来的自由度。进一步提出联合最小化预测误差、能耗与延迟的优化问题,证明其为NP-hard,并通过连续凸逼近转化为几何规划求解,具备性能保证。在真实数据集上的实验表明,相比现有方法,Fed-Span实现更快收敛、32%能耗降低和41%延迟减少。
原文摘要 · Abstract (English)
In this work, we introduce Fed-Span: \textit{\underline{fed}erated learning with \underline{span}ning aggregation over low Earth orbit (LEO) satellite constellations}. Fed-Span aims to address critical challenges inherent to distributed learning in dynamic satellite networks, including intermittent satellite connectivity, heterogeneous computational capabilities of satellites, and time-varying satellites' datasets. At its core, Fed-Span leverages minimum spanning tree (MST) and minimum spanning forest (MSF) topologies to introduce spanning model aggregation and dispatching processes for distributed learning. To formalize Fed-Span, we offer a fresh perspective on MST/MSF topologies by formulating them through a set of continuous constraint representations (CCRs), thereby integrating these topologies into a distributed learning framework for satellite networks. Using these CCRs, we obtain the energy consumption and latency of operations in Fed-Span. Moreover, we derive novel convergence bounds for Fed-Span, accommodating its key system characteristics and degrees of freedom (i.e., tunable parameters). Finally, we propose a comprehensive optimization problem that jointly minimizes model prediction loss, energy consumption, and latency of {Fed-Span}. We unveil that this problem is NP-hard and develop a systematic approach to transform it into a geometric programming formulation, solved via successive convex optimization with performance guarantees. Through evaluations on real-world datasets, we demonstrate that Fed-Span outperforms existing methods, with faster model convergence, greater energy efficiency, and reduced latency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。