用强化学习+模仿学习,让卫星在未知干扰下稳定控姿。
Imitation Learning for Satellite Attitude Control under Unknown Perturbations
- 结合SAC与GAIL,通过专家示范训练智能控制策略。
- 在多种扰动下仍能可靠对准天线方向,抗干扰能力更强。
- 适合航天器自主控制研究者,降低训练成本并提升泛化性。
本文提出一种新型卫星姿态控制框架,融合软演员-评论家(SAC)强化学习与生成对抗模仿学习(GAIL),在各种未知扰动下实现鲁棒性能。传统控制方法依赖精确系统模型,对参数不确定性和外部扰动敏感。为此,我们首先设计基于SAC的专家控制器,在执行机构故障、传感器噪声和姿态偏移等挑战场景中表现更优,相比此前结果显著提升。随后利用GAIL训练学习者策略,模仿专家轨迹,从而降低训练成本并增强泛化能力。初步实验显示,该框架在单一及复合扰动下均能将天线旋转至指定方向,并保持姿态稳定。此外,GAIL学习者可有效复现专家轨迹特征。对比评估与消融实验验证了SAC算法与奖励塑造的有效性;集成GAIL进一步减少样本复杂度,展现出良好的模仿能力,为更智能、自主的航天器控制系统铺平道路。
原文摘要 · Abstract (English)
This paper presents a novel satellite attitude control framework that integrates Soft Actor-Critic (SAC) reinforcement learning with Generative Adversarial Imitation Learning (GAIL) to achieve robust performance under various unknown perturbations. Traditional control techniques often rely on precise system models and are sensitive to parameter uncertainties and external perturbations. To overcome these limitations, we first develop a SAC-based expert controller that demonstrates improved resilience against actuator failures, sensor noise, and attitude misalignments, outperforming our previous results in several challenging scenarios. We then use GAIL to train a learner policy that imitates the expert's trajectories, thereby reducing training costs and improving generalization through expert demonstrations. Preliminary experiments under single and combined perturbations show that the SAC expert can rotate the antenna to a specified direction and keep the antenna orientation reliably stable in most of the listed perturbations. Additionally, the GAIL learner can imitate most of the features from the trajectories generated by the SAC expert. Comparative evaluations and ablation studies confirm the effectiveness of the SAC algorithm and reward shaping. The integration of GAIL further reduces sample complexity and demonstrates promising imitation capabilities, paving the way for more intelligent and autonomous spacecraft control systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。