arXiv:2606.05407cs.RO2026-06

让灵巧手连续抓取多物体,不放掉已抓物,提升操作效率。

MoDex: A Diffusion Policy for Sequential Multi-Object Dexterous Grasping

论文配图:MoDex: A Diffusion Policy for Sequential Multi-Object Dexterous Grasping
图 1 · 摘自论文原文
  • 用扩散模型直接预测抓取姿态,通过指节空间控制参与抓取的指尖
  • 仿真与实机测试中成功率提升6.7%-17.8%,优于现有学习方法
  • 适合需要连续精细操作的机器人场景,如装配、分拣

本文针对单个灵巧手在不释放已抓物体的前提下顺序抓取多个物体的问题提出MoDex。现有灵巧抓取方法常将所有自由度用于单一物体,浪费冗余能力。MoDex采用扩散策略,从观测和反对称空间(opposition space)及点云中直接预测下一抓取位姿。反对称空间条件指定参与当前抓取的指节,使手仅使用部分自由度,保留其余自由度以应对后续抓取。为促进仿真到现实的迁移,训练分两阶段:先通过模仿学习在专家演示上预训练,再通过强化学习微调,持续提升成功率。在基于MuJoCo的Franka Emika Panda机器人及Allegro手的仿真与真实平台测试中,MoDex表现优于对比的基于学习的方法,在仿真中成功率提升2.92-17.92%,真实环境中提升6.67-17.78%。

原文摘要 · Abstract (English)

This work addresses sequentially grasping multiple objects with a single dexterous hand without releasing those already held. Most dexterous grasping methods commit all of the hand's degrees of freedom to a single object, underutilizing its dexterity and leaving no redundancy for subsequent grasps. The proposed solution, MoDex, is a diffusion policy that predicts the next gripper pose directly from observations, conditioned on an opposition space and point cloud. The opposition space condition specifies which fingers participate in the current grasp, enabling the gripper to use only a subset of its available degrees of freedom while reserving the remaining degrees of freedom for subsequent grasps. To facilitate sim-to-real transfer, MoDex is trained in two stages: first through imitation learning on expert demonstrations, and subsequently through reinforcement learning fine-tuning, which consistently improves success rates over the pre-trained policy. We evaluate MoDex in simulation on a MuJoCo-based Franka Emika Panda robot equipped with an Allegro Hand and on the corresponding real-world hardware platform. Across both simulation and real-world experiments, MoDex achieves higher success rates than the evaluated learning-based baselines, improving performance by 2.92-17.92% and 6.67-17.78%, respectively. Project page: https://modex2026.github.io/.

灵巧操作扩散模型多物体抓取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。