arXiv:2502.16976cs.ROcs.CV2025-02ICRA被引 10

解决复杂场景下任务导向的6自由度抓取问题,让机器人更懂人类意图。

Task-Oriented 6-DoF Grasp Pose Detection in Clutters

  • 基于任务需求选择抓取点并生成对应姿态,实现端到端抓取决策。
  • 构建包含200万+抓取姿势的大规模数据集,覆盖198种物体和6类任务。
  • 实机测试验证其在真实杂乱环境中的抓取准确性与实用性。

人类根据任务不同采用不同的抓取方式,如‘握刀柄切割’与‘握刀刃递送’。现有机器人抓取研究虽考虑任务导向性,但多受限于低自由度夹爪或无杂乱场景,难以应用于真实人机协作。为此,本文提出任务导向6自由度抓取在杂乱环境中的新问题(TO6DGC),并构建大规模数据集6DTG,涵盖4391个杂乱场景、超过200万条6-DoF抓取标注,涉及198种物体和6类任务。同时提出单阶段任务抓取模型OSTG,通过任务感知点选择与姿态生成模块,实现精准抓取决策。大量实验表明,该方法在多个指标上优于基线,真实机器人测试也验证了其对任务相关抓取点和6-DoF姿态的准确感知能力。

原文摘要 · Abstract (English)

In general, humans would grasp an object differently for different tasks, e.g., "grasping the handle of a knife to cut" vs. "grasping the blade to hand over". In the field of robotic grasp pose detection research, some existing works consider this task-oriented grasping and made some progress, but they are generally constrained by low-DoF gripper type or non-cluttered setting, which is not applicable for human assistance in real life. With an aim to get more general and practical grasp models, in this paper, we investigate the problem named Task-Oriented 6-DoF Grasp Pose Detection in Clutters (TO6DGC), which extends the task-oriented problem to a more general 6-DOF Grasp Pose Detection in Cluttered (multi-object) scenario. To this end, we construct a large-scale 6-DoF task-oriented grasping dataset, 6-DoF Task Grasp (6DTG), which features 4391 cluttered scenes with over 2 million 6-DoF grasp poses. Each grasp is annotated with a specific task, involving 6 tasks and 198 objects in total. Moreover, we propose One-Stage TaskGrasp (OSTG), a strong baseline to address the TO6DGC problem. Our OSTG adopts a task-oriented point selection strategy to detect where to grasp, and a task-oriented grasp generation module to decide how to grasp given a specific task. To evaluate the effectiveness of OSTG, extensive experiments are conducted on 6DTG. The results show that our method outperforms various baselines on multiple metrics. Real robot experiments also verify that our OSTG has a better perception of the task-oriented grasp points and 6-DoF grasp poses.

抓取检测6-DoF任务导向杂乱环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。