arXiv:2412.16490cs.RO2024-12ICRA被引 40

用双层优化高效生成高质量机械手抓取数据,实测成功率超80%

BODex: Scalable and Efficient Robotic Dexterous Grasp Synthesis Using Bilevel Optimization

  • 将抓取合成建模为双层优化,结合二次规划与梯度下降
  • 单卡3090每秒生成49次抓取,仿真成功率均超75%,穿透深度<1mm
  • 新数据集让学习模型成功率从40%提升至80%,适合机器人抓取研究者

机械手灵巧抓取对环境交互至关重要。为释放数据驱动模型在灵巧抓取中的潜力,需大规模高质量数据集。尽管基于梯度的优化是构建此类数据集的可行方法,但此前工作存在效率低、抓取质量能量函数假设强或实验对象有限等问题。此外,缺乏统一基准也阻碍了该领域进展。为此,我们开发了一个高效的合成系统与基于MuJoCo的综合性基准。将抓取合成建模为双层优化问题,结合新颖的下层二次规划(QP)与上层梯度下降。利用最新的CUDA加速机器人库和基于GPU的QP求解器,系统可并行处理数千次抓取,在单张3090显卡上实现每秒超过49次的生成速度。针对Shadow、Allegro和Leap机械手生成的抓取在仿真中成功率均高于75%,穿透深度低于1毫米,优于现有基线方法。相比此前大规模数据集DexGraspNet,本数据集显著提升学习模型性能,仿真成功率由约40%提升至80%。在真实世界中,基于该数据训练的Shadow Hand模型在20种不同物体上达到81%的成功率。代码与数据集已发布于项目主页:https://pku-epic.github.io/BODex。

原文摘要 · Abstract (English)

Robotic dexterous grasping is important for interacting with the environment. To unleash the potential of data-driven models for dexterous grasping, a large-scale, high-quality dataset is essential. While gradient-based optimization offers a promising way for constructing such datasets, previous works suffer from limitations, such as inefficiency, strong assumptions in the grasp quality energy, or limited object sets for experiments. Moreover, the lack of a standard benchmark for comparing different methods and datasets hinders progress in this field. To address these challenges, we develop a highly efficient synthesis system and a comprehensive benchmark with MuJoCo for dexterous grasping. We formulate grasp synthesis as a bilevel optimization problem, combining a novel lower-level quadratic programming (QP) with an upper-level gradient descent process. By leveraging recent advances in CUDA-accelerated robotic libraries and GPU-based QP solvers, our system can parallelize thousands of grasps and synthesize over 49 grasps per second on a single 3090 GPU. Our synthesized grasps for Shadow, Allegro, and Leap hands all achieve a success rate above 75% in simulation, with a penetration depth under 1 mm, outperforming existing baselines on nearly all metrics. Compared to the previous large-scale dataset, DexGraspNet, our dataset significantly improves the performance of learning models, with a success rate from around 40% to 80% in simulation. Real-world testing of the trained model on the Shadow Hand achieves an 81% success rate across 20 diverse objects. The codes and datasets are released on our project page: https://pku-epic.github.io/BODex.

灵巧抓取双层优化机器人数据生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。