打造一套高精度、低成本、通用型人形机器人遥操作系统
OmniClone: Engineering a Robust, All-Rounder Whole-Body Humanoid Teleoperation System
- 设计诊断性基准OmniBench,分层评估动作性能
- 单块消费级显卡实现多技能高保真控制,误差降低66%以上
- 支持多种操控源,适配不同体型操作者,易部署
全身人形机器人遥操作可作为实时操作工具,并为自主学习提供可扩展的示范数据。现有系统依赖聚合指标,掩盖了关键失败模式。本文提出OmniClone系统,通过OmniBench诊断基准在未见动作上分层评估策略,揭示此前系统仅在特定动作中表现良好。基于诊断结果,优化训练数据并引入无主体差异的动捕重映射与鲁棒通信机制,使均关节位置误差(MPJPE)下降超66%,计算资源需求比同类方法少数个数量级。系统具备源无关性:单一统一策略支持实时遥操作、生成动作回放及视觉-语言-动作模型,且跨操作者体型泛化能力强。该系统将诊断评估与工程实践结合,为可扩展的人形遥操作与自主学习提供实用基础。
原文摘要 · Abstract (English)
Whole-body humanoid teleoperation enables humans to remotely control humanoid robots, serving as both a real-time operational tool and a scalable engine for collecting demonstrations for autonomous learning. Despite recent advances, existing systems are validated using aggregate metrics that conflate distinct motion regimes, masking critical failure modes. This lack of diagnostic granularity, compounded by tightly coupled and labor-intensive system configurations, hinders robust real-world deployment. A key open challenge is building a teleoperation system that is simultaneously robust, versatile, and affordable for practical use. Here we present OmniClone, a whole-body humanoid teleoperation system that achieves high-fidelity, multi-skill control on a single consumer GPU with modest data requirements. Central to our approach is OmniBench, a diagnostic benchmark that evaluates policies across stratified motion categories and difficulty levels on unseen motions, exposing the narrow specialization of prior systems. Guided by these diagnostics, we identify an optimized training data recipe and integrate system-level improvements: subject-agnostic retargeting and robust communication, that collectively reduce Mean Per-Joint Position Error (MPJPE) by over 66% while requiring orders-of-magnitude fewer computational resources than comparable methods. Crucially, OmniClone is control-source-agnostic: a single unified policy supports real-time teleoperation, generated motion playback, and Vision-Language-Action (VLA) models, while generalizing across operators of vastly different body proportions. By uniting diagnostic evaluation with practical engineering, OmniClone provides an accessible foundation for scalable humanoid teleoperation and autonomous learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。