arXiv:2607.22119cs.ROcs.AI2026-07

提出动态双臂协作框架,让机器人用更少数据学会在动环境中配合操作。

One Hand Watches The Other: Dynamic Multi-Agent Cooperation for Sample-Efficient Bimanual Manipulation in Dynamic Environments

论文配图:One Hand Watches The Other: Dynamic Multi-Agent Cooperation for Sample-Efficient Bimanual Manipulation in Dynamic Environments
图 1 · 摘自论文原文
  • 将对手臂视为动态参数,统一建模双臂协作与动态环境交互
  • 比顶尖方法性能高35个百分点,样本量仅需其1/20
  • 零样本迁移能力,可直接从静态演示适配动态场景

多流机器人操作策略通过相对于环境参考系建模动作,实现了前所未有的样本效率和泛化能力。然而,现有方法通常假设这些参考系为外部固定。在动态场景(如单臂操作移动物体或双臂协同)中,此因果假设失效——每只手臂都成为另一只手臂的动态环境。我们提出DynaMAC,一种轻量、与策略无关的框架,解决这一因果限制,同时保持多流策略的样本效率、计算速度与灵活性。DynaMAC将对手臂视为动态任务参数,无需显式主从关系即可统一建模动态操作与双臂协调。为严格评估,我们引入DynaBench,首个面向动态环境的机器人操作基准。在动态环境与双臂操作任务中,DynaMAC性能优于领先概率与生成基线超35个百分点,且样本需求仅为后者的1/20。关键在于,它能零样本从静态演示泛化至动态环境,显著简化数据收集,为人类-机器人协作铺平道路。

原文摘要 · Abstract (English)

Multi-stream robot manipulation policies achieve unparalleled sample efficiency and generalization by modeling actions relative to environmental reference frames. However, existing approaches typically assume these frames to be strictly exogenous. This causal assumption collapses in dynamic settings, such as when a single robot arm manipulates a moving object or when two arms coordinate, where each arm effectively becomes part of the dynamic environment of the other. We propose DynaMAC, a lightweight, policy-agnostic framework that resolves this causal limitation while preserving the sample efficiency, computational speed, and flexibility of multi-stream policies, DynaMAC treats the opposite arm as a dynamic task parameter, thereby providing a unified formulation for dynamic manipulation and bimanual coordination without requiring an explicit leader-follower relationship. To rigorously evaluate these capabilities, we introduce DynaBench, a novel benchmark for robot manipulation in dynamic environments. Across both dynamic environments and bimanual manipulation tasks, DynaMAC outperforms leading probabilistic and generative baselines by over 35 percentage points while requiring 20 times fewer samples. Crucially, DynaMAC generalizes zero-shot from static demonstrations to dynamic environments, substantially simplifying data collection and establishing an elegant bridge toward human-robot collaboration.

双臂协作动态环境样本效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。