让机器人双手分工协作,高效学会开瓶倒液等复杂操作。
AsymDex: Asymmetry and Relative Coordinates for RL-based Bimanual Dexterity
- 一手主控、一手辅助,降低动作空间复杂度
- 通过相对位姿控制提升双臂协调性,样本效率更高
- 支持多种不对称操作,适配真实机械手应用
我们提出 AsymDex,一种新颖且简单的强化学习框架,可在无需示范的情况下高效学习多指灵巧手的各类双臂技能。核心思路有二:其一,借鉴人类普遍存在的‘惯用手’现象,为双手分配互补角色——辅助手负责重定位与姿态调整,主导手完成复杂操作(如开瓶盖、倒液体);其二,强调双臂间相对运动控制对协同的重要性,设计了相对观测与动作空间,并引入相对位姿跟踪控制器。此外,提出两阶段分解结构,可无缝集成近期抓取学习成果,实现从物体抓取到操控的全流程学习。相比现有方法在样本效率或任务泛化上的不足,AsymDex在七个不对称双臂灵巧操作任务(四组仿真、三组真实世界)中均显著优于强基线模型。项目主页:https://sites.google.com/view/asymdex-2025/
原文摘要 · Abstract (English)
We present Asymmetric Dexterity (AsymDex), a novel and simple reinforcement learning (RL) framework that can efficiently learn a large class of bimanual skills in multi-fingered hands without relying on demonstrations. Two crucial insights enable AsymDex to reduce the observation and action space dimensions and improve sample efficiency. First, true ambidexterity is rare in humans and most of us exhibit strong "handedness". Inspired by this observation, we assign complementary roles to each hand: the facilitating hand repositions and reorients one object, while the dominant hand performs complex manipulations to achieve the desired result (e.g., opening a bottle cap, or pouring liquids). Second, controlling the relative motion between the hands is crucial for coordination and synchronization of the two hands. As such, we design relative observation and action spaces and leverage a relative-pose tracking controller. Further, we propose a two-phase decomposition in which AsymDex can be readily integrated with recent advances in grasp learning to facilitate both the acquisition and manipulation of objects using two hands. Unlike existing RL-based methods for bimanual dexterity with multi-fingered hands, which are either sample inefficient or tailored to a specific task, AsymDex can efficiently learn a wide variety of bimanual skills that exhibit asymmetry. Detailed experiments on seven asymmetric bimanual dexterous manipulation tasks (four simulated and three real-world) reveal that AsymDex consistently outperforms strong baselines that challenge our design choices. The project website is at https://sites.google.com/view/asymdex-2025/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。