arXiv:2504.10403cs.LGcs.DC2025-04

卫星与地面协同细调大模型,解决太空算力不足与通信延迟问题。

Satellite Federated Fine-Tuning for Foundation Models in Space Computing Power Networks

  • 分拆模型组件,由卫星与地面协同完成细调。
  • 仿真显示训练时间缩短约33%。
  • 适合需要低延迟遥感推理的星上AI系统。

人工智能与低地球轨道(LEO)卫星的发展推动了大规模遥感基础模型在各类下游任务中的应用。然而,直接将这些模型下载至地面进行微调面临隐私顾虑和带宽受限的问题。卫星联邦学习(FL)通过在轨微调并聚合模型更新而无需传输数据提供了解决方案。但对大型基础模型而言,传统卫星FL框架下卫星的计算能力不足以支持有效的在轨微调。为此,我们提出一种星地协同的联邦微调框架。核心在于如何合理分解并分配模型组件,以缓解在轨计算资源不足。微调过程中,卫星通过与地面站或其他卫星交换中间结果完成前向与反向传播,由于空间网络特有的通信拓扑(如间歇性星地通信、短暂通信窗口、不稳定的星间链路),带来通信挑战。为降低传输延迟,我们引入结合通信与计算资源的定制化通信策略:包括并行同轨通信、拓扑感知星地通信、以及最小化时延的跨轨通信策略,有效降低空间通信开销。仿真结果表明,训练时间显著减少,提升约33%。

原文摘要 · Abstract (English)

Advancements in artificial intelligence (AI) and low-earth orbit (LEO) satellites have promoted the application of large remote sensing foundation models for various downstream tasks. However, direct downloading of these models for fine-tuning on the ground is impeded by privacy concerns and limited bandwidth. Satellite federated learning (FL) offers a solution by enabling model fine-tuning directly on-board satellites and aggregating model updates without data downloading. Nevertheless, for large foundation models, the computational capacity of satellites is insufficient to support effective on-board fine-tuning in traditional satellite FL frameworks. To address these challenges, we propose a satellite-ground collaborative federated fine-tuning framework. The key of the framework lies in how to reasonably decompose and allocate model components to alleviate insufficient on-board computation capabilities. During fine-tuning, satellites exchange intermediate results with ground stations or other satellites for forward propagation and back propagation, which brings communication challenges due to the special communication topology of space transmission networks, such as intermittent satellite-ground communication, short duration of satellite-ground communication windows, and unstable inter-orbit inter-satellite links (ISLs). To reduce transmission delays, we further introduce tailored communication strategies that integrate both communication and computing resources. Specifically, we propose a parallel intra-orbit communication strategy, a topology-aware satellite-ground communication strategy, and a latency-minimalization inter-orbit communication strategy to reduce space communication costs. Simulation results demonstrate significant reductions in training time with improvements of approximately 33%.

联邦学习星上计算遥感通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。