arXiv:2503.09078cs.RO2025-03被引 11

用四指灵巧手分步抓取两物,确保不掉落且动作稳定。

Sequential Multi-Object Grasping with One Dexterous Hand

  • 先生成单物抓取候选,再合并为双物抓握配置。
  • 仿真测试成功率达65.8%,真实世界达56.7%。
  • 结合扩散模型与启发式策略,适合复杂抓取任务。

人类能灵活使用双手连续抓取多个物体,但机器人因物体形状多样、多指手高自由度接触交互复杂,实现此类操作困难。本文提出SeqMultiGrasp系统,利用四指Allegro手实现分步抓取两个物体:先完全包裹并抬起第一个,再抓第二个而不掉落。系统先在物理仿真中生成并验证单物抓取姿态(仅使用部分手指链接),再合并为双物抓握构型。针对真实部署,训练一个基于点云的扩散模型生成抓取姿势,并采用启发式执行策略。在仿真中测试8×8种物体组合,1,600次试验成功率65.8%;真实世界测试6×3组合,90次试验成功率56.7%,表明该方法在多指手分步抓取中具有潜力。

原文摘要 · Abstract (English)

Sequentially grasping multiple objects with multi-fingered hands is common in daily life, where humans can fully leverage the dexterity of their hands to enclose multiple objects. However, the diversity of object geometries and the complex contact interactions required for high-DOF hands to grasp one object while enclosing another make sequential multi-object grasping challenging for robots. In this paper, we propose SeqMultiGrasp, a system for sequentially grasping objects with a four-fingered Allegro Hand. We focus on sequentially grasping two objects, ensuring that the hand fully encloses one object before lifting it and then grasps the second object without dropping the first. Our system first synthesizes single-object grasp candidates, where each grasp is constrained to use only a subset of the hand's links. These grasps are then validated in a physics simulator to ensure stability and feasibility. Next, we merge the validated single-object grasp poses to construct multi-object grasp configurations. For real-world deployment, we train a diffusion model conditioned on point clouds to propose grasp poses, followed by a heuristic-based execution strategy. We test our system using $8 \times 8$ object combinations in simulation and $6 \times 3$ object combinations in real. Our diffusion-based grasp model obtains an average success rate of 65.8% over 1,600 simulation trials and 56.7% over 90 real-world trials, suggesting that it is a promising approach for sequential multi-object grasping with multi-fingered hands. Supplementary material is available on our project website: https://hesic73.github.io/SeqMultiGrasp.

灵巧手多物体抓取扩散模型仿真到现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。