arXiv:2511.12390cs.RO2025-11

用强化学习替代传统控制,让人形机器人远程操作更自然、抗干扰更强。

Learning Adaptive Neural Teleoperation for Humanoid Robots: From Inverse Kinematics to End-to-End Control

  • 用神经网络直接映射虚拟现实输入到机械臂动作,跳过繁琐的逆运动学计算。
  • 实测跟踪误差降低34%,动作平滑度提升45%,且能自动适应外力扰动。
  • 适合需要高自然度和鲁棒性的远程操控场景,如救援或精密装配。

虚拟现实(VR)遥操作已成为控制人形机器人完成复杂操作任务的有前景方法。然而,传统系统依赖逆运动学(IK)求解器和手动调参的PD控制器,在应对外部力、适应不同用户以及动态条件下的自然运动表现不佳。本文提出一种基于学习的神经遥操作系统,将传统的IK+PD流程替换为通过强化学习训练的策略。该方法直接将VR控制器输入映射为机器人关节指令,隐式处理受力干扰,生成平滑轨迹,并自适应用户偏好。我们在模拟环境中使用基于IK的遥操作示范数据初始化策略,随后通过施加随机外力和轨迹平滑性奖励进行微调。在Unitree G1人形机器人上的实验表明,所提策略相比IK基线实现34%更低的跟踪误差、45%更高的动作平滑度,并具备更优的抗干扰能力,同时保持实时性能(50Hz控制频率)。验证任务包括物品抓取放置、开门及双手协同操作。结果表明,基于学习的方法可显著提升人形机器人遥操作的自然性与鲁棒性。

原文摘要 · Abstract (English)

Virtual reality (VR) teleoperation has emerged as a promising approach for controlling humanoid robots in complex manipulation tasks. However, traditional teleoperation systems rely on inverse kinematics (IK) solvers and hand-tuned PD controllers, which struggle to handle external forces, adapt to different users, and produce natural motions under dynamic conditions. In this work, we propose a learning-based neural teleoperation framework that replaces the conventional IK+PD pipeline with learned policies trained via reinforcement learning. Our approach learns to directly map VR controller inputs to robot joint commands while implicitly handling force disturbances, producing smooth trajectories, and adapting to user preferences. We train our policies in simulation using demonstrations collected from IK-based teleoperation as initialization, then fine-tune them with force randomization and trajectory smoothness rewards. Experiments on the Unitree G1 humanoid robot demonstrate that our learned policies achieve 34% lower tracking error, 45% smoother motions, and superior force adaptation compared to the IK baseline, while maintaining real-time performance (50Hz control frequency). We validate our approach on manipulation tasks including object pick-and-place, door opening, and bimanual coordination. These results suggest that learning-based approaches can significantly improve the naturalness and robustness of humanoid teleoperation systems.

人形机器人遥操作强化学习运动控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。