arXiv:2503.09186cs.ROcs.LG2025-03ICCV被引 26

提出解耦交互框架,让双臂机器人更灵活地处理协作与独立任务。

Rethinking Bimanual Robotic Manipulation: Learning with Decoupled Interaction Framework

  • 为每只机械臂分配独立模型,仅在需要时通过选择性模块交互
  • 在7个任务上比当前最优方法提升23.5%成功率,模型体积仅为1/6
  • 适用于多智能体场景,可无缝接入现有方法,适合复杂操作研究

双臂机器人操作是机器人领域的重要方向。以往方法多采用整合控制模型,将双臂感知与状态作为输入,直接预测动作。但此类方法强制早期协同,忽略了大量无需显式合作的独立任务(如用最近的手抓取物体)。本文提出一种解耦交互框架,根据任务特性分别建模:为每臂设置独立模型以强化非协同任务学习,同时引入选择性交互模块,自适应融合单臂信息以提升协同任务表现。在RoboTwin数据集上的7项任务实验表明:(1) 框架性能显著领先,较SOTA提升23.5%;(2) 具有良好兼容性,可无缝集成至现有方法;(3) 可有效拓展至多智能体操作,较整合控制类SOTA提升28%;(4) 性能提升源于解耦设计本身,在仅1/6模型规模下仍比SOTA高16.5%成功率。

原文摘要 · Abstract (English)

Bimanual robotic manipulation is an emerging and critical topic in the robotics community. Previous works primarily rely on integrated control models that take the perceptions and states of both arms as inputs to directly predict their actions. However, we think bimanual manipulation involves not only coordinated tasks but also various uncoordinated tasks that do not require explicit cooperation during execution, such as grasping objects with the closest hand, which integrated control frameworks ignore to consider due to their enforced cooperation in the early inputs. In this paper, we propose a novel decoupled interaction framework that considers the characteristics of different tasks in bimanual manipulation. The key insight of our framework is to assign an independent model to each arm to enhance the learning of uncoordinated tasks, while introducing a selective interaction module that adaptively learns weights from its own arm to improve the learning of coordinated tasks. Extensive experiments on seven tasks in the RoboTwin dataset demonstrate that: (1) Our framework achieves outstanding performance, with a 23.5% boost over the SOTA method. (2) Our framework is flexible and can be seamlessly integrated into existing methods. (3) Our framework can be effectively extended to multi-agent manipulation tasks, achieving a 28% boost over the integrated control SOTA. (4) The performance boost stems from the decoupled design itself, surpassing the SOTA by 16.5% in success rate with only 1/6 of the model size.

双臂机器人解耦学习多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。