arXiv:2606.14561cs.ROcs.LG2026-06

开源统一平台让机械手学习更高效,支持从操作到训练全流程

ORCA: A Platform for Open-Source Dexterity Research

论文配图:ORCA: A Platform for Open-Source Dexterity Research
图 1 · 摘自论文原文
  • 构建统一接口整合控制、仿真、远程操控与手势迁移
  • 支持消费级VR设备采集专家示范,实现端到端自主策略训练
  • 兼容主流机器人学习框架,适合做灵巧操作研究的团队使用

机器人抓取研究越来越关注双指平行夹爪,因其高效、廉价且易于远程操控。但夹爪受形态限制,即使简单翻转任务也常需双手配合。类人手结构更接近人类手部,具备从人类视频中学习的能力,然而在学习研究中仍难应用:尽管存在开源手部硬件,其控制、仿真、远程操控与姿态迁移的软件分散于临时代码库,且与主流机器人学习生态脱节。本文提出orca学习栈,一个将底层控制、仿真、多源消费级平台远程操控及手部姿态迁移统一于单一接口的开源研究堆栈,并原生集成lerobot等主流机器人学习框架,使灵巧手研究者可复用非灵巧操作的通用数据、训练与评估流程。我们展示了完整端到端工作流:通过消费级VR头显远程操控采集手内翻转任务的专家示范,使用lerobot训练自主策略,并在可复现、可观测环境中评估所学策略。整个堆栈已开源,为灵巧操作研究提供共享、可复现的基础平台。

原文摘要 · Abstract (English)

Robotics manipulation research increasingly focuses on two-finger parallel grippers for their effectiveness, affordability, and ease of teleoperation. Grippers are nonetheless limited by their form factor, often requiring bimanual setups even for simple reorientation tasks. Anthropomorphic hands are a more natural platform for dexterous robot learning -- closer to the human hand, and capable of learning from human video -- yet they remain hard to use in learning research: even where open and accessible hand hardware exists, the software for control, simulation, teleoperation, and retargeting is scattered in one-off code bases, and largely disconnected from the robot-learning ecosystem. In this work, we introduce the \orca~learning stack, an open-source research stack for dexterity as a first-class robot learning domain. Our \orca~stack unifies low-level control, simulation, teleoperation from a range of consumer platforms, and hand retargeting, behind a single interface, and integrates natively with popular robot-learning frameworks such as \lerobot, so dexterous hand researchers can leverage the same data, training, and evaluation pipelines used for non-dexterous robot learning. We demonstrate a complete end-to-end workflow, collecting expert demonstrations of an in-hand reorientation task by teleoperation with a consumer-grade VR headset, training an autonomous policy with \lerobot, and evaluating the learned policy in a fully reproducible and observable setup. We open-source the entire stack as a shared, reproducible foundation for dexterous-manipulation research.

灵巧操作开源平台机器人学习虚拟现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。