自动生成31种灵巧抓握,覆盖全类型且真实可行。
Dexonomy: Synthesizing All Dexterous Grasp Types in a Grasp Taxonomy
- 先调物体贴合手模板,再局部优化手形适应物体。
- 生成950万次抓握,31种类型全覆盖,仿真成功率显著提升。
- 可直接用于真实机器人抓取,单视角点云识别成功率82.3%。
通用灵巧抓握能力是智能机器人必备技能,但需覆盖大量抓握类型(如GRASP分类体系中的至少31类)的高质量数据集支持,而数据采集极为困难。现有自动抓握生成方法通常局限于特定类型或物体类别,难以扩展。本文提出高效流水线,可为任意手型、抓握类型和物体生成接触丰富、无穿透、物理合理的抓握动作。从每种手型与抓握类型的单一人工标注模板出发,分两阶段求解:先优化物体以适配手模板,再在仿真中局部调整手形以贴合物体。为验证生成结果,引入一种接触感知控制策略,使手在每个接触点施加恰当力。经验证的抓握可作为新模板用于后续合成。实验表明,该方法在仿真中显著优于此前不区分抓握类型的基线模型。利用本算法构建的数据集包含10.7万个物体与950万次抓握,覆盖全部31类抓握类型。最后,训练了一个类型条件生成模型,仅需单视角点云即可成功执行目标抓握类型,真实世界实验成功率达82.3%。
原文摘要 · Abstract (English)
Generalizable dexterous grasping with suitable grasp types is a fundamental skill for intelligent robots. Developing such skills requires a large-scale and high-quality dataset that covers numerous grasp types (i.e., at least those categorized by the GRASP taxonomy), but collecting such data is extremely challenging. Existing automatic grasp synthesis methods are often limited to specific grasp types or object categories, hindering scalability. This work proposes an efficient pipeline capable of synthesizing contact-rich, penetration-free, and physically plausible grasps for any grasp type, object, and articulated hand. Starting from a single human-annotated template for each hand and grasp type, our pipeline tackles the complicated synthesis problem with two stages: optimize the object to fit the hand template first, and then locally refine the hand to fit the object in simulation. To validate the synthesized grasps, we introduce a contact-aware control strategy that allows the hand to apply the appropriate force at each contact point to the object. Those validated grasps can also be used as new grasp templates to facilitate future synthesis. Experiments show that our method significantly outperforms previous type-unaware grasp synthesis baselines in simulation. Using our algorithm, we construct a dataset containing 10.7k objects and 9.5M grasps, covering 31 grasp types in the GRASP taxonomy. Finally, we train a type-conditional generative model that successfully performs the desired grasp type from single-view object point clouds, achieving an 82.3% success rate in real-world experiments. Project page: https://pku-epic.github.io/Dexonomy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。