arXiv:2602.11321cs.RO2026-02被引 4

直接控制人形机器人末端,实现50ms超低延迟操作。

ExtremControl: Low-Latency Humanoid Teleoperation with Direct Extremity Control

  • 直接在人体末端的SE(3)位姿上操作,跳过全身体运动重定向。
  • 实测端到端延迟低至50ms,支持快速反应任务。
  • 适合需要高响应性的机器人远程操控场景。

构建低延迟人形机器人遥操作系统对采集多样化的动态示范至关重要。然而,现有方法依赖高度预处理的人体到人形运动重定向和仅位置的PD控制,导致显著延迟,严重限制响应性,难以完成需快速反馈的任务。为此,我们提出ExtremControl,一种低延迟全身控制框架:(1)直接在选定刚性链接(主要为人体末端)的SE(3)位姿上操作,避免全身体运动重定向;(2)采用笛卡尔空间映射,将人体动作直接转换为机器人链接目标;(3)在底层引入速度前馈控制,支持快速变化控制界面下的高度响应行为。我们进一步提供ExtremControl的统一理论公式,并通过仿真与真实环境实验系统验证其有效性。基于此,我们实现了支持光学动捕与VR追踪的低延迟遥操作系统,端到端延迟低至50ms,可实现乒乓球平衡、抛接、实时返回等高度响应行为,显著超越此前200ms的延迟上限。

原文摘要 · Abstract (English)

Building a low-latency humanoid teleoperation system is essential for collecting diverse reactive and dynamic demonstrations. However, existing approaches rely on heavily pre-processed human-to-humanoid motion retargeting and position-only PD control, resulting in substantial latency that severely limits responsiveness and prevents tasks requiring rapid feedback and fast reactions. To address this problem, we propose ExtremControl, a low latency whole-body control framework that: (1) operates directly on SE(3) poses of selected rigid links, primarily humanoid extremities, to avoid full-body retargeting; (2) utilizes a Cartesian-space mapping to directly convert human motion to humanoid link targets; and (3) incorporates velocity feedforward control at low level to support highly responsive behavior under rapidly changing control interfaces. We further provide a unified theoretical formulation of ExtremControl and systematically validate its effectiveness through experiments in both simulation and real-world environments. Building on ExtremControl, we implement a low-latency humanoid teleoperation system that supports both optical motion capture and VR-based motion tracking, achieving end-to-end latency as low as 50ms and enabling highly responsive behaviors such as ping-pong ball balancing, juggling, and real-time return, thereby substantially surpassing the 200ms latency limit observed in prior work.

遥操作低延迟人形机器人运动控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。