统一建模机器人与物体交互,实现跨机械臂灵巧抓取
$\mathcal{D(R,O)}$ Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Grasping
- 用机器人姿态和物体点云构建统一交互表示
- 仿真中平均成功率87.53%,1秒内完成抓取预测
- 适配多种机械臂和物体,真实场景成功率89%
灵巧抓取是机器人操作中的基础但极具挑战性的技能,需精确协调机械手与物体之间的交互。本文提出 $\ ext{D(R,O)}$ Grasp 框架,通过建模机械手在抓取姿态下与物体的交互关系,实现对多种机械臂和物体几何形态的广泛泛化。该模型以机械手描述和物体点云为输入,高效预测出运动学有效且稳定的抓取动作,在模拟与真实环境中的大量实验验证了其有效性。在三种不同灵巧机械臂上测试,仿真平均成功率达87.53%,推理时间小于1秒;在真实世界使用LeapHand实验时,平均成功率达到89%。该方法为复杂多变环境中灵巧抓取提供了鲁棒解决方案。代码、附录及视频详见项目网站:https://nus-lins-lab.github.io/drograspweb/。
原文摘要 · Abstract (English)
Dexterous grasping is a fundamental yet challenging skill in robotic manipulation, requiring precise interaction between robotic hands and objects. In this paper, we present $\mathcal{D(R,O)}$ Grasp, a novel framework that models the interaction between the robotic hand in its grasping pose and the object, enabling broad generalization across various robot hands and object geometries. Our model takes the robot hand's description and object point cloud as inputs and efficiently predicts kinematically valid and stable grasps, demonstrating strong adaptability to diverse robot embodiments and object geometries. Extensive experiments conducted in both simulated and real-world environments validate the effectiveness of our approach, with significant improvements in success rate, grasp diversity, and inference speed across multiple robotic hands. Our method achieves an average success rate of 87.53% in simulation in less than one second, tested across three different dexterous robotic hands. In real-world experiments using the LeapHand, the method also demonstrates an average success rate of 89%. $\mathcal{D(R,O)}$ Grasp provides a robust solution for dexterous grasping in complex and varied environments. The code, appendix, and videos are available on our project website at https://nus-lins-lab.github.io/drograspweb/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。