让卫星自带大模型,实时处理遥感数据
Satellite Edge Artificial Intelligence with Large Models: Architectures and Technologies

- 分模块部署大模型,卫星与地面协同训练
- 将大模型拆解为轻量微服务,支持多任务实时推理
- 适合遥感、灾情监测等需要快速响应的场景
随着智能遥感应用需求增长,基于大规模无标签数据预训练并微调的大模型显著提升了各类下游任务的性能。然而,极端天气预警、灾害监测和战场监视等任务需实时处理,传统将原始数据传回地面站的方式存在延迟高、可信度低的问题。为此,卫星边缘AI通过空间计算网络(Space-CPN)的通信-计算融合能力,实现数据在轨处理,提升时效性、有效性与可信度。卫星边缘大模型(LAM)涵盖训练与推理阶段,关键挑战在于资源受限且拓扑动态变化的空间网络中,如何设计可扩展的任务分解机制。本文提出一种卫星联邦微调架构,将LAM模块分布在星地网络以高效微调;引入微服务驱动的边缘推理架构,将LAM组件虚拟化为轻量级微服务,适配多任务多模态推理;最后讨论未来方向,包括面向任务的通信、类脑计算及卫星边缘AI网络优化。
原文摘要 · Abstract (English)
Driven by the growing demand for intelligent remote sensing applications, large artificial intelligence (AI) models pre-trained on large-scale unlabeled datasets and fine-tuned for downstream tasks have significantly improved learning performance for various downstream tasks due to their generalization capabilities. However, many specific downstream tasks, such as extreme weather nowcasting (e.g., downburst and tornado), disaster monitoring, and battlefield surveillance, require real-time data processing. Traditional methods via transferring raw data to ground stations for processing often cause significant issues in terms of latency and trustworthiness. To address these challenges, satellite edge AI provides a paradigm shift from ground-based to on-board data processing by leveraging the integrated communication-and-computation capabilities in space computing power networks (Space-CPN), thereby enhancing the timeliness, effectiveness, and trustworthiness for remote sensing downstream tasks. Moreover, satellite edge large AI model (LAM) involves both the training (i.e., fine-tuning) and inference phases, where a key challenge lies in developing computation task decomposition principles to support scalable LAM deployment in resource-constrained space networks with time-varying topologies. In this article, we first propose a satellite federated fine-tuning architecture to split and deploy the modules of LAM over space and ground networks for efficient LAM fine-tuning. We then introduce a microservice-empowered satellite edge LAM inference architecture that virtualizes LAM components into lightweight microservices tailored for multi-task multimodal inference. Finally, we discuss the future directions for enhancing the efficiency and scalability of satellite edge LAM, including task-oriented communication, brain-inspired computing, and satellite edge AI network optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。