arXiv:2509.24661cs.ROcs.CV2025-09被引 19

用人体接触数据生成机器人抓取,实现跨机械臂的海量高质抓握。

CEDex: Cross-Embodiment Dexterous Grasp Generation at Scale from Human-like Contact Representations

  • 通过人体接触表征对齐机器人运动学,实现跨形态抓握生成。
  • 构建50万物体、2000万抓握的大规模跨机械臂数据集。
  • 适合需要多样化抓取能力的机器人研发人员使用。

跨机械臂灵巧抓握生成指为不同结构的机器人手自适应生成并优化抓握策略,对实现多样化环境中的通用机器人操作至关重要,但需要大量可靠且多样的抓握数据支撑模型训练与泛化。现有方法或依赖物理优化缺乏类人运动理解,或需大量人工标注,仅限于类人结构。本文提出CEDex,一种大规模跨机械臂灵巧抓握生成方法,通过将机器人运动学模型与生成的人体接触表征对齐,实现跨模态抓握生成。给定物体点云和任意机器人手模型,CEDex首先利用预训练的条件变分自编码器生成人体接触表征;随后通过拓扑合并将多个手部部件统一为机器人组件,并基于符号距离场与物理感知约束进行抓握优化。基于CEDex,我们构建了迄今最大的跨机械臂抓握数据集,包含50万物体、4种夹持器类型,总计2000万次抓握。大量实验表明,CEDex性能超越现有最优方法,该数据集为跨机械臂抓握学习提供了高质量多样性支持。

原文摘要 · Abstract (English)

Cross-embodiment dexterous grasp synthesis refers to adaptively generating and optimizing grasps for various robotic hands with different morphologies. This capability is crucial for achieving versatile robotic manipulation in diverse environments and requires substantial amounts of reliable and diverse grasp data for effective model training and robust generalization. However, existing approaches either rely on physics-based optimization that lacks human-like kinematic understanding or require extensive manual data collection processes that are limited to anthropomorphic structures. In this paper, we propose CEDex, a novel cross-embodiment dexterous grasp synthesis method at scale that bridges human grasping kinematics and robot kinematics by aligning robot kinematic models with generated human-like contact representations. Given an object's point cloud and an arbitrary robotic hand model, CEDex first generates human-like contact representations using a Conditional Variational Auto-encoder pretrained on human contact data. It then performs kinematic human contact alignment through topological merging to consolidate multiple human hand parts into unified robot components, followed by a signed distance field-based grasp optimization with physics-aware constraints. Using CEDex, we construct the largest cross-embodiment grasp dataset to date, comprising 500K objects across four gripper types with 20M total grasps. Extensive experiments show that CEDex outperforms state-of-the-art approaches and our dataset benefits cross-embodiment grasp learning with high-quality diverse grasps.

灵巧抓取跨机械臂生成模型数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。