arXiv:2503.00056cs.ROcs.SY2025-03被引 3

分层强化学习让多卫星巡检更稳定,实测表现优异。

Stability Analysis of Deep Reinforcement Learning for Multi-Agent Inspection in a Terrestrial Testbed

  • 用高层规划+低层控制分层架构提升任务分配与轨迹执行效率。
  • 在真实测试平台下任务完成率高,燃料消耗和移动距离可控。
  • 适合研究太空自主系统或需要跨仿真-实测部署的场景。

为应对航天任务中可靠性要求高、运行时间长及通信受限等挑战,本研究评估了一种用于多智能体卫星巡检的分层深度强化学习(DRL)框架的稳定性与性能。该框架结合高层引导策略与低层运动控制器,实现可扩展的任务分配与高效轨迹执行。实验在本地协同卫星智能网络(LINCS)测试平台上进行,涵盖从仿真环境到网络物理测试平台的不同保真度条件。关键指标包括任务完成率、行驶距离与燃料消耗,结果表明,在存在传感器噪声、动态扰动及运行时保障(RTA)约束等现实不确定性情况下,该框架仍表现出强鲁棒性与适应能力。研究验证了该分层控制器能有效弥合仿真到现实的差距,维持高任务完成率并适应复杂真实环境,具备未来航天任务中实现自主卫星操作的潜力。

原文摘要 · Abstract (English)

The design and deployment of autonomous systems for space missions require robust solutions to navigate strict reliability constraints, extended operational duration, and communication challenges. This study evaluates the stability and performance of a hierarchical deep reinforcement learning (DRL) framework designed for multi-agent satellite inspection tasks. The proposed framework integrates a high-level guidance policy with a low-level motion controller, enabling scalable task allocation and efficient trajectory execution. Experiments conducted on the Local Intelligent Network of Collaborative Satellites (LINCS) testbed assess the framework's performance under varying levels of fidelity, from simulated environments to a cyber-physical testbed. Key metrics, including task completion rate, distance traveled, and fuel consumption, highlight the framework's robustness and adaptability despite real-world uncertainties such as sensor noise, dynamic perturbations, and runtime assurance (RTA) constraints. The results demonstrate that the hierarchical controller effectively bridges the sim-to-real gap, maintaining high task completion rates while adapting to the complexities of real-world environments. These findings validate the framework's potential for enabling autonomous satellite operations in future space missions.

强化学习多智能体航天系统仿真到现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。