arXiv:2409.16048cs.ROcs.AI2024-09ICRA被引 28

让四足机器人在复杂地形上精准控制机械臂末端位置。

Whole-body End-Effector Pose Tracking

  • 基于强化学习构建全身动作策略,支持大范围工作空间
  • 在楼梯斜坡等复杂地形上实现2.64厘米、3.64度的追踪误差
  • 适合需要移动机械臂作业的工业或救援场景

将操作能力与四足机器人的移动性结合对众多机器人应用至关重要。然而,将机械臂与移动基座集成显著增加系统复杂性,导致末端执行器精确控制困难。现有基于模型的方法受限于建模假设,鲁棒性不足;近期强化学习方法通常将机械臂工作区限制在机器人前方,或仅跟踪位置,难以获得良好精度。本文提出一种全身体强化学习框架,用于在粗糙非结构化地形上实现大范围工作空间内的末端执行器位姿跟踪。方法包含地形感知的初始构型与末端位姿指令采样策略,并采用基于游戏的课程学习扩展机器人工作范围。我们在搭载六自由度机械臂的ANYmal四足机器人上验证了该方法。实验表明,所学控制器可在大范围工作空间内实现高精度指令跟踪,并适应楼梯、斜坡等复杂地形。部署结果中位姿追踪误差为2.64厘米和3.64度,优于现有竞争基线。

原文摘要 · Abstract (English)

Combining manipulation with the mobility of legged robots is essential for a wide range of robotic applications. However, integrating an arm with a mobile base significantly increases the system's complexity, making precise end-effector control challenging. Existing model-based approaches are often constrained by their modeling assumptions, leading to limited robustness. Meanwhile, recent Reinforcement Learning (RL) implementations restrict the arm's workspace to be in front of the robot or track only the position to obtain decent tracking accuracy. In this work, we address these limitations by introducing a whole-body RL formulation for end-effector pose tracking in a large workspace on rough, unstructured terrains. Our proposed method involves a terrain-aware sampling strategy for the robot's initial configuration and end-effector pose commands, as well as a game-based curriculum to extend the robot's operating range. We validate our approach on the ANYmal quadrupedal robot with a six DoF robotic arm. Through our experiments, we show that the learned controller achieves precise command tracking over a large workspace and adapts across varying terrains such as stairs and slopes. On deployment, it achieves a pose-tracking error of 2.64 cm and 3.64 degrees, outperforming existing competitive baselines.

强化学习四足机器人末端控制运动规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。