多模态抓取+自适应调整,提升复杂环境中机械臂抓取成功率。
Corner-Grasp: Multi-Action Grasp Detection and Active Gripper Adaptation for Grasping in Cluttered Environments
- 融合吸力与指夹的多功能夹爪,支持多种物体抓取。
- 通过主动调节吸盘和手指运动,避免夹爪撞上容器角落。
- 基于RGB-D图像的神经网络模型,实现在真实场景中的精准抓点检测。
机器人抓取是实现物理交互的关键能力。尽管研究广泛,仍面临目标物形状多样、传感误差及环境碰撞等挑战。本文针对杂乱料箱抓取场景,提出一种结合吸力与指夹的多功能夹爪,并设计主动夹爪自适应策略,通过往复式吸盘和可重构手指运动减少硬件与环境碰撞。为充分发挥夹爪性能,构建了从仿真生成的大规模合成数据集训练的神经网络,可从单张RGB-D图像中同时检测吸力点与指夹点。此外,提出高效的真实世界数据构建方法,支持在不同特征物体上的抓点检测。实验表明,该方法可在杂乱料箱场景中成功抓取物体并避免与容器角落等环境约束发生碰撞。本方法在2024年ICRA举办的第九届机器人抓取与操作竞赛(RGMC)中表现优异。
原文摘要 · Abstract (English)
Robotic grasping is an essential capability, playing a critical role in enabling robots to physically interact with their surroundings. Despite extensive research, challenges remain due to the diverse shapes and properties of target objects, inaccuracies in sensing, and potential collisions with the environment. In this work, we propose a method for effectively grasping in cluttered bin-picking environments where these challenges intersect. We utilize a multi-functional gripper that combines both suction and finger grasping to handle a wide range of objects. We also present an active gripper adaptation strategy to minimize collisions between the gripper hardware and the surrounding environment by actively leveraging the reciprocating suction cup and reconfigurable finger motion. To fully utilize the gripper's capabilities, we built a neural network that detects suction and finger grasp points from a single input RGB-D image. This network is trained using a larger-scale synthetic dataset generated from simulation. In addition to this, we propose an efficient approach to constructing a real-world dataset that facilitates grasp point detection on various objects with diverse characteristics. Experiment results show that the proposed method can grasp objects in cluttered bin-picking scenarios and prevent collisions with environmental constraints such as a corner of the bin. Our proposed method demonstrated its effectiveness in the 9th Robotic Grasping and Manipulation Competition (RGMC) held at ICRA 2024.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。