用深度强化学习+触觉反馈,提升太空碎片软捕获成功率。
Improving Soft-Capture Phase Success in Space Debris Removal Missions: Leveraging Deep Reinforcement Learning and Tactile Feedback
- 通过深度强化学习自动学出软捕获策略,无需手动设计特征。
- 触觉传感器显著提升捕获成功率,在噪声数据下仍表现稳定。
- 纯仿真训练,无需真实数据或先验知识,适合机器人自主控制场景。
传统控制方法依赖运动方程等模型,但在接触与摩擦问题上易导致控制器不稳定且精度不足,常需人工调参。强化学习则能有效应对接触相关挑战,成为构建鲁棒机器人控制器的可行方案。本文提出一种深度强化学习方法,用于处理自由漂浮移动目标(主要是空间碎片)的软捕获阶段,尤其在存在噪声数据的情况下。研究强调了触觉传感器在软捕获阶段的关键作用。通过深度强化学习,无需人工设计特征,使机器人能够通过试错自主学习捕获策略。为促进有效学习,我们设计了一种专用奖励函数,提供清晰且有意义的反馈。整个控制策略完全在仿真环境中训练,无需直接示范或任务先验知识。实验结果表明该方法具有良好性能,凸显触觉信息的重要性。代码与仿真结果已开源至Soft_Capture_Tactile仓库。
原文摘要 · Abstract (English)
Traditional control methods effectively manage robot operations using models like motion equations but face challenges with issues of contact and friction, leading to unstable and imprecise controllers that often require manual tweaking. Reinforcement learning, however, has developed as a capable solution for developing robust robot controllers that excel in handling contact-related challenges. In this work, we introduce a deep reinforcement learning approach to tackle the soft-capture phase for free-floating moving targets, mainly space debris, amidst noisy data. Our findings underscore the crucial role of tactile sensors, even during the soft-capturing phase. By employing deep reinforcement learning, we eliminate the need for manual feature design, simplifying the problem and allowing the robot to learn soft-capture strategies through trial and error. To facilitate effective learning of the approach phase, we have crafted a specialized reward function that offers clear and insightful feedback to the agent. Our method is trained entirely within the simulation environment, eliminating the need for direct demonstrations or prior knowledge of the task. The developed control policy shows promising results, highlighting the necessity of using tactile sensor information. The code and simulation results are available at Soft_Capture_Tactile repo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。