构建仿真基准,统一评估双臂灵巧遥操作技术效果
TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperation
- 以仿真为中心设计30个高保真任务环境
- 四种操作模态在模拟与真实平台表现高度相关
- 适合遥操作算法与硬件系统对比研究者使用
遥操作是具身机器人学习的核心,双臂灵巧遥操作能提供自主系统难以获取的丰富示范。尽管现有研究提出了从惯性动捕手套到外骨骼、视觉接口等多种硬件方案,仍缺乏统一的基准来公平、可复现地比较这些系统。本文提出TeleOpBench,一个面向双臂灵巧遥操作的仿真中心基准。该基准包含30个高保真任务环境,涵盖抓取放置、工具使用和协作操作,覆盖广泛的动作与力交互难度。在其中实现了四种代表性遥操作模态:(i) 动捕,(ii) VR设备,(iii) 臂手外骨骼,(iv) 单目视觉追踪,并采用统一协议与度量体系进行评估。为验证仿真性能是否可预测真实表现,我们在配备两个6-DoF灵巧手的物理双臂平台上进行了镜像实验。在10个保留任务中,仿真与硬件性能呈现强相关性,证实了TeleOpBench的外部有效性。该基准为遥操作研究建立统一标准,也为未来算法与硬件创新提供可扩展平台。代码已开源:https://github.com/cyjdlhy/TeleOpBench。
原文摘要 · Abstract (English)
Teleoperation is a cornerstone of embodied-robot learning, and bimanual dexterous teleoperation in particular provides rich demonstrations that are difficult to obtain with fully autonomous systems. While recent studies have proposed diverse hardware pipelines-ranging from inertial motion-capture gloves to exoskeletons and vision-based interfaces-there is still no unified benchmark that enables fair, reproducible comparison of these systems. In this paper, we introduce TeleOpBench, a simulator-centric benchmark tailored to bimanual dexterous teleoperation. TeleOpBench contains 30 high-fidelity task environments that span pick-and-place, tool use, and collaborative manipulation, covering a broad spectrum of kinematic and force-interaction difficulty. Within this benchmark we implement four representative teleoperation modalities-(i) MoCap, (ii) VR device, (iii) arm-hand exoskeletons, and (iv) monocular vision tracking-and evaluate them with a common protocol and metric suite. To validate that performance in simulation is predictive of real-world behavior, we conduct mirrored experiments on a physical dual-arm platform equipped with two 6-DoF dexterous hands. Across 10 held-out tasks we observe a strong correlation between simulator and hardware performance, confirming the external validity of TeleOpBench. TeleOpBench establishes a common yardstick for teleoperation research and provides an extensible platform for future algorithmic and hardware innovation. Codes is now available at https://github.com/cyjdlhy/TeleOpBench .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。