用强化学习让轮式四足机械臂直接追踪末端六维位姿,实现精准稳定操作。
Learning Whole-Body Loco-Manipulation for Omni-Directional Task Space Pose Tracking with a Wheeled-Quadrupedal-Manipulator
- 设计非线性奖励融合模块,协调多任务间的层级关系。
- 在仿真与硬件上实现小于5cm位置误差、0.1弧度旋转误差的高精度追踪。
- 适合机器人运动控制、智能系统研发人员参考。
本文研究基于强化学习(RL)的全身运动操作问题,聚焦于如何协调轮式四足机械臂的浮点基座与机械臂,以实现任务空间中末端执行器(EE)的直接六维(6D)位姿追踪。不同于传统同时追踪基座与末端指令的问题,直接末端位姿追踪需在冗余自由度间保持内在平衡。为此,我们提出一种新型奖励融合模块(RFM),通过非线性方式系统整合不同任务的奖励项,有效建模运动操作的多阶段与分层特性。结合师生强化学习训练范式,构建完整的RL方案,实现轮式四足机械臂的6D末端位姿追踪。大量仿真与硬件实验表明,该方法可实现平滑精确的跟踪性能,达到小于5厘米的位置误差和小于0.1弧度的旋转误差,优于现有方法。
原文摘要 · Abstract (English)
In this paper, we study the whole-body loco-manipulation problem using reinforcement learning (RL). Specifically, we focus on the problem of how to coordinate the floating base and the robotic arm of a wheeled-quadrupedal manipulator robot to achieve direct six-dimensional (6D) end-effector (EE) pose tracking in task space. Different from conventional whole-body loco-manipulation problems that track both floating-base and end-effector commands, the direct EE pose tracking problem requires inherent balance among redundant degrees of freedom in the whole-body motion. We leverage RL to solve this challenging problem. To address the associated difficulties, we develop a novel reward fusion module (RFM) that systematically integrates reward terms corresponding to different tasks in a nonlinear manner. In such a way, the inherent multi-stage and hierarchical feature of the loco-manipulation problem can be carefully accommodated. By combining the proposed RFM with the a teacher-student RL training paradigm, we present a complete RL scheme to achieve 6D EE pose tracking for the wheeled-quadruped manipulator robot. Extensive simulation and hardware experiments demonstrate the significance of the RFM. In particular, we enable smooth and precise tracking performance, achieving state-of-the-art tracking position error of less than 5 cm, and rotation error of less than 0.1 rad. Please refer to https://clearlab-sustech.github.io/RFM_loco_mani/ for more experimental videos.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。