用强化学习优化卫星群中遥感模型的部署,降低延迟并应对数据不确定性。
Microservice Deployment in Space Computing Power Networks via Robust Reinforcement Learning
- 将遥感任务拆分为微服务,提升资源利用效率。
- 在不确定数据下仍能保持低精度损失与可控计算开销。
- 适合需要实时推理的低轨卫星遥感系统部署。
随着地球观测需求增长,提供可靠的实时遥感推理服务以满足低延迟要求至关重要。空间计算网络(Space-CPN)通过星上计算与广覆盖能力,为实时推理提供了可行方案。本文提出一种面向低轨卫星星座的遥感人工智能应用部署框架,采用微服务架构将单体推理任务分解为可复用、独立的模块,以应对高延迟与资源异构性问题。该分布式方法实现最优微服务部署,降低资源占用同时满足服务质量与功能需求。针对数据不确定性,引入鲁棒优化,并将该问题建模为部分可观测马尔可夫决策过程,提出一种鲁棒强化学习算法处理半无限的服务质量约束。所提方法获得次优解,在维持可接受计算成本的同时最小化精度损失。仿真结果验证了框架的有效性。
原文摘要 · Abstract (English)
With the growing demand for Earth observation, it is important to provide reliable real-time remote sensing inference services to meet the low-latency requirements. The Space Computing Power Network (Space-CPN) offers a promising solution by providing onboard computing and extensive coverage capabilities for real-time inference. This paper presents a remote sensing artificial intelligence applications deployment framework designed for Low Earth Orbit satellite constellations to achieve real-time inference performance. The framework employs the microservice architecture, decomposing monolithic inference tasks into reusable, independent modules to address high latency and resource heterogeneity. This distributed approach enables optimized microservice deployment, minimizing resource utilization while meeting quality of service and functional requirements. We introduce Robust Optimization to the deployment problem to address data uncertainty. Additionally, we model the Robust Optimization problem as a Partially Observable Markov Decision Process and propose a robust reinforcement learning algorithm to handle the semi-infinite Quality of Service constraints. Our approach yields sub-optimal solutions that minimize accuracy loss while maintaining acceptable computational costs. Simulation results demonstrate the effectiveness of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。