用指尖空间云和接触感知采样,高效生成类人抓取数据
Dexterous grasp data augmentation based on grasp synthesis with fingertip workspace cloud and contact-aware sampling
- 基于操作演示生成指尖工作空间云,免去逆运动学计算
- 在YCB物体上生成速度更快、有效抓取率更高
- 适合任意机械手结构,实时生成类人抓握姿态
机器人抓取是各类应用的基础环节。随着神经网络发展,数据驱动的抓取方法成为主流,但高效生成抓取数据集仍是瓶颈,尤其面对多样化的机械手结构时更难设计通用生成方法。本文提出一种基于遥操作的框架,采集少量抓取姿态示范,并通过FSG(指尖接触感知采样式抓取生成器)进行数据增强。基于示范姿态,我们提出AutoWS,可自动生成嵌入手部结构信息的指尖工作空间云,无需逆运动学计算。在YCB物体上的实验表明,该方法在生成速度与有效姿态率方面显著优于现有方法。该框架支持任意结构机械手的实时抓取生成,结合示范可产生类人抓取,为数据驱动抓取训练提供高效可靠的增广工具。
原文摘要 · Abstract (English)
Robotic grasping is a fundamental yet crucial component of robotic applications, as effective grasping often serves as the starting point for various tasks. With the rapid advancement of neural networks, data-driven approaches for robotic grasping have become mainstream. However, efficiently generating grasp datasets for training remains a bottleneck. This is compounded by the diverse structures of robotic hands, making the design of generalizable grasp generation methods even more complex. In this work, we propose a teleoperation-based framework to collect a small set of grasp pose demonstrations, which are augmented using FSG--a Fingertip-contact-aware Sampling-based Grasp generator. Based on the demonstrated grasp poses, we propose AutoWS, which automatically generates structured workspace clouds of robotic fingertips, embedding the hand structure information directly into the clouds to eliminate the need for inverse kinematics calculations. Experiments on grasping the YCB objects show that our method significantly outperforms existing approaches in both speed and valid pose generation rate. Our framework enables real-time grasp generation for hands with arbitrary structures and produces human-like grasps when combined with demonstrations, providing an efficient and robust data augmentation tool for data-driven grasp training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。