用点云补全生成完整形状特征,提升单视角抓取精度
PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp
- 将单视角点云补全为完整几何形状,作为特征输入抓取网络
- 真实场景下抓取成功率比顶尖方法高17.8%
- 结合评分过滤器,提升实际机器人执行的可行性
基于点云的6-自由度抓取方法在机器人抓取中展现出巨大潜力,但现有方法多依赖单视角深度图生成的2.5D点云,仅包含物体表面一侧信息,导致几何信息不完整,影响抓取判断,降低精度。受人类通过几何经验推断物体形状的启发,本文提出一种新框架:将点云补全结果转化为物体形状特征,用于训练6-DoF抓取网络。点云补全可从2.5D点云生成近似完整的点集,类似人类对形状的感知;将其转换为形状特征,即利用该信息提升抓取效率。此外,针对网络输出与实际执行之间的差距,引入评分过滤模块,筛选更具可执行性的抓取提议。实验表明,使用完整点特征可显著提高抓取提案准确性,评分过滤大幅增强真实机器人抓取的可信度。本方法在真实场景中抓取成功率较当前最优方法提升17.8%。
原文摘要 · Abstract (English)
The 6-Degree of Freedom (DoF) grasp method based on point clouds has shown significant potential in enabling robots to grasp target objects. However, most existing methods are based on the point clouds (2.5D points) generated from single-view depth images. These point clouds only have one surface side of the object providing incomplete geometry information, which mislead the grasping algorithm to judge the shape of the target object, resulting in low grasping accuracy. Humans can accurately grasp objects from a single view by leveraging their geometry experience to estimate object shapes. Inspired by humans, we propose a novel 6-DoF grasping framework that converts the point completion results as object shape features to train the 6-DoF grasp network. Here, point completion can generate approximate complete points from the 2.5D points similar to the human geometry experience, and converting it as shape features is the way to utilize it to improve grasp efficiency. Furthermore, due to the gap between the network generation and actual execution, we integrate a score filter into our framework to select more executable grasp proposals for the real robot. This enables our method to maintain a high grasp quality in any camera viewpoint. Extensive experiments demonstrate that utilizing complete point features enables the generation of significantly more accurate grasp proposals and the inclusion of a score filter greatly enhances the credibility of real-world robot grasping. Our method achieves a 17.8\% success rate higher than the state-of-the-art method in real-world experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。