让一个人操作三臂机器人,通过重定时演示数据实现高效协作。
Tri-Manual Visuomotor Imitation Learning of Robot Policies

- 用依赖感知调度重排三臂动作顺序,保留原始运动特征
- 六项真实任务中协调效率提升,成功率与原数据相当
- 适合三臂机器人操作、无需部署额外调度器的场景
双臂遥操作可高效收集机器人示范数据,但当机器人有三臂时,单个操作者仅能持续控制两臂,导致三臂独立动作被迫串行记录,行为克隆会复制接口延迟而非任务需求。我们提出TriManPolicy系统,使一名操作者可示范三臂行为。核心是依赖感知三臂调度(DATS),其在离线阶段保留固定时长的局部传感运动片段,并根据任务顺序和机械臂使用约束重新安排执行时机。生成的数据用于训练统一同步策略,部署时无需依赖图或调度器。六个真实世界任务测试表明,经DATS重定时的示范数据所训练策略具有更优协调效率,任务成功率保持不变。离线分析显示,DATS改变了跨臂监督关系,而非简单消除空闲期。项目视频与补充材料见 https://aus.bot/trimanpolicy/。
原文摘要 · Abstract (English)
Bimanual teleoperation provides an effective way to collect robot demonstrations, but it assumes that the operator and robot have matching numbers of simultaneous control channels. This assumption breaks for tri-manual systems: the robot can coordinate three arms concurrently, whereas a single operator can continuously control only two. Pairwise mode switching may therefore record otherwise independent motions sequentially, causing behaviour cloning to reproduce delays imposed by the interface rather than required by the task. We present TriManPolicy, a tri-manual imitation learning system that allows one operator to demonstrate behaviours for three arms. Its central component is Dependency-Aware Tri-Arm Scheduling (DATS). The key idea is to preserve the demonstrated arm motions while reconsidering when they occur. DATS retimes demonstrations offline by preserving local sensorimotor segments of fixed duration and repositioning them according to constraints on task order and arm usage that are reviewed by a human. The resulting data train a single synchronous policy for all three arms, while deployment requires neither the dependency graph nor the scheduler. Across six challenging tasks performed in the real world, policies trained on demonstrations retimed by DATS exhibit more efficient coordination while maintaining comparable observed task success. Offline analysis further shows that DATS changes the supervision across arms rather than merely removing idle periods. Project videos and additional material are available at https://aus.bot/trimanpolicy/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。