用普通手柄实现移动机器人全身操作,零成本提升任务效率
Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost
- 通过已有控制接口推断末端执行器动作,由强化学习代理负责移动基座
- 任务完成时间显著缩短,5次示范即可实现新场景技能迁移
- 适合需要自由移动的复杂任务,无需专用硬件或人体姿态匹配
演示数据在学习复杂行为和训练机器人基础模型中起关键作用。尽管静态机械臂已有高效控制界面,但移动机械臂因自由度高,数据采集仍繁琐耗时。现有专用硬件、虚拟化身或动作捕捉虽可实现全身控制,却往往昂贵、依赖特定机器人,或存在人机体感不一致问题。本文提出MoMa-Teleop,一种新颖遥操作方法:从已有接口推断末端执行器运动,将基座运动交由预先训练的强化学习代理处理,使操作者专注任务相关的末端动作。该方法通过标准手柄或手势引导,实现移动机械臂的全身遥操作,无需额外硬件或设置成本。操作者不受追踪工作区限制,可在空间扩展任务中自由移动。实验表明,该方法显著缩短各类机器人与任务的任务完成时间。生成的数据涵盖多样化全身运动且无体感错配,支持高效模仿学习。聚焦任务特定末端动作,仅需5次示范即可学习可迁移技能,适应新障碍物或物体位置变化。代码与视频见https://moma-teleop.cs.uni-freiburg.de。
原文摘要 · Abstract (English)
Demonstration data plays a key role in learning complex behaviors and training robotic foundation models. While effective control interfaces exist for static manipulators, data collection remains cumbersome and time intensive for mobile manipulators due to their large number of degrees of freedom. While specialized hardware, avatars, or motion tracking can enable whole-body control, these approaches are either expensive, robot-specific, or suffer from the embodiment mismatch between robot and human demonstrator. In this work, we present MoMa-Teleop, a novel teleoperation method that infers end-effector motions from existing interfaces and delegates the base motions to a previously developed reinforcement learning agent, leaving the operator to focus fully on the task-relevant end-effector motions. This enables whole-body teleoperation of mobile manipulators with no additional hardware or setup costs via standard interfaces such as joysticks or hand guidance. Moreover, the operator is not bound to a tracked workspace and can move freely with the robot over spatially extended tasks. We demonstrate that our approach results in a significant reduction in task completion time across a variety of robots and tasks. As the generated data covers diverse whole-body motions without embodiment mismatch, it enables efficient imitation learning. By focusing on task-specific end-effector motions, our approach learns skills that transfer to unseen settings, such as new obstacles or changed object positions, from as little as five demonstrations. We make code and videos available at https://moma-teleop.cs.uni-freiburg.de.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。