解决人形机器人长时间操作中的位置漂移问题,实现精准动作模仿。
CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation
- 通过高频定位反馈构建闭环控制,实时纠正全局姿态偏差。
- 在真实人形机器人上实现高动态、高精度的长期动作追踪,无漂移。
- 适合需要稳定远程操控的工业或服务场景,尤其关注长时操作可靠性。
长时间全身体人形机器人遥操作因累积的全局姿态漂移而面临挑战,尤其是针对全尺寸人形机器人。尽管近期基于学习的追踪方法可实现敏捷协调运动,但通常在机器人局部坐标系下运行,忽略全局姿态反馈,导致长时间执行中出现漂移与不稳定性。本文提出CLOT,一种实时全身体人形机器人遥操作系统,通过高频定位反馈实现闭环全局运动追踪。CLOT在闭环中同步操作者与机器人的姿态,实现长时间无漂移的人体到人形机器人动作模仿。然而,直接施加全局追踪奖励于强化学习常引发激进且脆弱的修正。为此,我们提出一种数据驱动的随机化策略,将观测轨迹与奖励评估解耦,实现平滑稳定的全局修正。此外,通过对抗性运动先验对策略进行正则化,抑制非自然行为。为支持CLOT,我们收集了20小时精心标注的人体运动数据以训练遥操作策略。采用基于Transformer的策略网络,并训练超过1300 GPU小时。该策略部署于含31个自由度(不含手部)的全尺寸人形机器人。仿真与真实世界实验均验证了其高动态运动、高精度追踪及强跨域鲁棒性。运动数据、演示视频与代码可在官网获取。
原文摘要 · Abstract (English)
Long-horizon whole-body humanoid teleoperation remains challenging due to accumulated global pose drift, particularly on full-sized humanoids. Although recent learning-based tracking methods enable agile and coordinated motions, they typically operate in the robot's local frame and neglect global pose feedback, leading to drift and instability during extended execution. In this work, we present CLOT, a real-time whole-body humanoid teleoperation system that achieves closed-loop global motion tracking via high-frequency localization feedback. CLOT synchronizes operator and robot poses in a closed loop, enabling drift-free human-to-humanoid mimicry over long timehorizons. However, directly imposing global tracking rewards in reinforcement learning, often results in aggressive and brittle corrections. To address this, we propose a data-driven randomization strategy that decouples observation trajectories from reward evaluation, enabling smooth and stable global corrections. We further regularize the policy with an adversarial motion prior to suppress unnatural behaviors. To support CLOT, we collect 20 hours of carefully curated human motion data for training the humanoid teleoperation policy. We design a transformer-based policy and train it for over 1300 GPU hours. The policy is deployed on a full-sized humanoid with 31 DoF (excluding hands). Both simulation and real-world experiments verify high-dynamic motion, high-precision tracking, and strong robustness in sim-to-real humanoid teleoperation. Motion data, demos and code can be found in our website.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。