用超椭球体建模大物体,实现移动机械臂的稳定抓取。
SuperQ-GRASP: Superquadrics-based Grasp Pose Estimation on Larger Objects for Mobile-Manipulation
- 基于多视角图像重建3D模型,再分解为可抓取的超椭球体
- 在椅子等大物体上实现90%以上抓取成功率,泛化性强
- 适合移动机械臂抓取大型家居物品,对视图不完整鲁棒
抓取规划是机器人学中的长期难题。传统数据驱动方法依赖充分的几何覆盖,但通常局限于桌面场景,难以推广到大型物体(如椅子)。单视角传感器数据常因遮挡导致不完整。本文提出一种几何方法:利用多视角RGB图像和NeRF技术构建隐式3D模型,生成显式网格并支持新视角感知;再将网格分解为超椭球体(SQs),每个对应预计算的抓取姿态,从而实现基于几何基元的抓取组合。该流程有效缓解深度噪声与视图缺失问题,并具备对任意尺寸物体的泛化能力。更多定性结果见附录视频及网页 https://bit.ly/3ZrOanU。
原文摘要 · Abstract (English)
Grasp planning and estimation have been a longstanding research problem in robotics, with two main approaches to find graspable poses on the objects: 1) geometric approach, which relies on 3D models of objects and the gripper to estimate valid grasp poses, and 2) data-driven, learning-based approach, with models trained to identify grasp poses from raw sensor observations. The latter assumes comprehensive geometric coverage during the training phase. However, the data-driven approach is typically biased toward tabletop scenarios and struggle to generalize to out-of-distribution scenarios with larger objects (e.g. chair). Additionally, raw sensor data (e.g. RGB-D data) from a single view of these larger objects is often incomplete and necessitates additional observations. In this paper, we take a geometric approach, leveraging advancements in object modeling (e.g. NeRF) to build an implicit model by taking RGB images from views around the target object. This model enables the extraction of explicit mesh model while also capturing the visual appearance from novel viewpoints that is useful for perception tasks like object detection and pose estimation. We further decompose the NeRF-reconstructed 3D mesh into superquadrics (SQs) -- parametric geometric primitives, each mapped to a set of precomputed grasp poses, allowing grasp composition on the target object based on these primitives. Our proposed pipeline overcomes the problems: a) noisy depth and incomplete view of the object, with a modeling step, and b) generalization to objects of any size. For more qualitative results, refer to the supplementary video and webpage https://bit.ly/3ZrOanU
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。