arXiv:2602.01632cs.RO2026-02被引 1

用人体上肢姿态直接对齐,实现机器人遥操作的快速精准映射。

A Closed-Form Geometric Retargeting Solver for Upper Body Humanoid Robot Teleoperation

  • 基于肩肘腕关键点姿态对齐,构建闭式几何求解器。
  • 推理速度达3kHz,显著快于传统方法且精度更高。
  • 适用于多数7自由度机械臂,适合实时遥操作与学习任务。

将人类动作映射到机器人姿态是双臂人形机器人遥操作的有效方法,但现有方法常因优化末端执行器位置与姿态而效率低下,导致运动失真或延迟。本文提出将映射问题重定义为姿态对齐,通过肩、肘、腕(SEW)关键点确定上下臂方向进行对齐,提出无需迭代的闭式几何求解算法——SEW-Mimic,具备最优性保证。该方法在标准商用CPU上可实现3kHz推理速度,计算开销小,可支持下游安全过滤以避免双臂自碰撞。方法适配大多数7自由度机器人及人形系统,不依赖输入关键点来源。实验表明,其在计算效率和精度上均优于现有方法;初步用户研究表明其提升了遥操作任务成功率;使用该方法采集的数据更平滑,有助于策略学习。此外,该方法可无缝集成至全身姿态映射流程中。硬件演示验证了其实用性。结果表明,SEW-Mimic是双臂机器人操作与人形机器人遥操作的核心基础模块。

原文摘要 · Abstract (English)

Retargeting human motion to robot poses is a practical approach for teleoperating bimanual humanoid robot arms, but existing methods can be suboptimal and slow, often causing undesirable motion or latency. This is due to optimizing to match robot end-effector to human hand position and orientation, which can also limit the robot's workspace to that of the human. Instead, this paper reframes retargeting as an orientation alignment problem, enabling a closed-form, geometric solution algorithm with an optimality guarantee. The key idea is to align a robot arm to a human's upper and lower arm orientations, as identified from shoulder, elbow, and wrist (SEW) keypoints; hence, the method is called SEW-Mimic. The method has fast inference (3 kHz) on standard commercial CPUs, leaving computational overhead for downstream applications; an example in this paper is a safety filter to avoid bimanual self-collision. The method suits most 7-degree-of-freedom robot arms and humanoids, and is agnostic to input keypoint source. Experiments show that SEW-Mimic outperforms other retargeting methods in computation time and accuracy. A pilot user study suggests that the method improves teleoperation task success. Preliminary analysis indicates that data collected with SEW-Mimic improves policy learning due to being smoother. SEW-Mimic is also shown to be a drop-in way to accelerate full-body humanoid retargeting. Finally, hardware demonstrations illustrate SEW-Mimic's practicality. The results emphasize the utility of SEW-Mimic as a fundamental building block for bimanual robot manipulation and humanoid robot teleoperation.

机器人控制姿态映射遥操作闭式解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。