arXiv:2410.09431cs.RO2024-10被引 1

新模型可适配多种夹爪,从点云中精准抓取多样物体。

REGNet V2: End-to-End REgion-based Grasp Detection Network for Grippers of Different Sizes in Point Clouds

  • 将夹爪参数嵌入点云,分三阶段预测抓取位姿
  • 真实杂乱场景下抓取成功率达74.98%,优于主流方法
  • 适合需适配不同夹爪的机器人抓取任务

抓取是机器人领域长期关键但具挑战性的问题。如何使抓取在非结构化环境中对新物体和新夹爪具备泛化与鲁棒性尤为困难。本文提出\regnet,一种可适配不同平行夹爪的机器人抓取系统。该系统将夹爪参数嵌入点云,基于此预测合适抓取位姿,包含三个组件:评分网络(SN)通过抓取置信度筛选候选点;抓取区域网络(GRN)生成一组抓取提案;精炼网络(RN)优化提案以提升精度与鲁棒性。我们设计了一种解析策略,从预测抓取集中选择最优执行抓取。为训练\regnet,构建了一个大规模抓取数据集,包含多种平行夹爪的无碰撞抓取配置。实验表明,在含20个物体的真实杂乱场景中,\regnet结合解析策略达到74.98%的成功率,显著优于GPD、PointNetGPD和S4G等先进方法。代码与数据集见https://github.com/zhaobinglei/REGNet-V2。

原文摘要 · Abstract (English)

Grasping has been a crucial but challenging problem in robotics for many years. One of the most important challenges is how to make grasping generalizable and robust to novel objects as well as grippers in unstructured environments. We present \regnet, a robotic grasping system that can adapt to different parallel jaws to grasp diversified objects. To support different grippers, \regnet embeds the gripper parameters into point clouds, based on which it predicts suitable grasp configurations. It includes three components: Score Network (SN), Grasp Region Network (GRN), and Refine Network (RN). In the first stage, SN is used to filter suitable points for grasping by grasp confidence scores. In the second stage, based on the selected points, GRN generates a set of grasp proposals. Finally, RN refines the grasp proposals for more accurate and robust predictions. We devise an analytic policy to choose the optimal grasp to be executed from the predicted grasp set. To train \regnet, we construct a large-scale grasp dataset containing collision-free grasp configurations using different parallel-jaw grippers. The experimental results demonstrate that \regnet with the analytic policy achieves the highest success rate of $74.98\%$ in real-world clutter scenes with $20$ objects, significantly outperforming several state-of-the-art methods, including GPD, PointNetGPD, and S4G. The code and dataset are available at https://github.com/zhaobinglei/REGNet-V2.

机器人抓取点云处理夹爪适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。