构建大规模真实杂乱场景数据集,提升机器人抓取鲁棒性。
GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes
- 采集1000个密集杂乱场景,每场景平均14.1个物体、62.6%遮挡。
- 提供736万条6D姿态和93亿个可行抓取点,覆盖200种物体与75种环境。
- 适合研究复杂场景感知与抓取的科研人员及工业机器人开发者。
在杂乱环境中实现鲁棒抓取仍是机器人领域的开放挑战。现有基准数据集多聚焦于简单场景,遮挡程度轻且多样性不足,难以适用于实际场景。本文提出GraspClutter6D,一个大规模真实世界抓取数据集,包含:(1) 1,000个高度杂乱场景,物体密度高(平均每场景14.1个物体),遮挡率达62.6%;(2) 覆盖200种物体与75种环境配置(收纳盒、货架、桌面等),通过四台RGB-D相机从多个视角采集;(3) 提供736万条6D物体位姿和93亿个可行机器人抓取点,对应52,000张RGB-D图像。我们对先进分割、位姿估计与抓取检测方法进行基准测试,揭示了复杂场景中的关键挑战。此外,验证该数据集作为训练资源的有效性,结果显示基于GraspClutter6D训练的抓取网络在仿真与真实实验中均显著优于现有数据集训练的结果。数据集、工具包与标注工具已公开于项目主页:https://sites.google.com/view/graspclutter6d。
原文摘要 · Abstract (English)
Robust grasping in cluttered environments remains an open challenge in robotics. While benchmark datasets have significantly advanced deep learning methods, they mainly focus on simplistic scenes with light occlusion and insufficient diversity, limiting their applicability to practical scenarios. We present GraspClutter6D, a large-scale real-world grasping dataset featuring: (1) 1,000 highly cluttered scenes with dense arrangements (14.1 objects/scene, 62.6\% occlusion), (2) comprehensive coverage across 200 objects in 75 environment configurations (bins, shelves, and tables) captured using four RGB-D cameras from multiple viewpoints, and (3) rich annotations including 736K 6D object poses and 9.3B feasible robotic grasps for 52K RGB-D images. We benchmark state-of-the-art segmentation, object pose estimation, and grasp detection methods to provide key insights into challenges in cluttered environments. Additionally, we validate the dataset's effectiveness as a training resource, demonstrating that grasping networks trained on GraspClutter6D significantly outperform those trained on existing datasets in both simulation and real-world experiments. The dataset, toolkit, and annotation tools are publicly available on our project website: https://sites.google.com/view/graspclutter6d.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。