一个模型同时控制夹爪和吸盘,让机器人一把抓多种物体。
MultiGraspNet: A Multitask 3D Vision Model for Multi-gripper Robotic Grasping
- 统一框架下并行预测夹爪与吸盘的抓取位姿。
- 在真实场景中比单用吸盘多抓16%已见物、32%新物体。
- 适合需要换工具的工业自动化场景。
基于视觉的机器人抓取模型可自动化完成重复且耗时的工业任务。现有方法通常存在两类局限:要么只针对单一夹爪,需昂贵的双臂系统;要么依赖定制化混合夹爪,需特定学习流程,难以跨任务迁移。本文提出MultiGraspNet,一种新型多任务3D深度学习方法,可在统一框架内同时预测平行夹爪与真空吸盘的可行抓取位姿,使单台机器人能灵活切换末端执行器。模型在标注丰富的GraspNet-1Billion与SuctionNet-1Billion数据集上训练,并对每个场景点生成抓取可行性掩码。通过共享早期特征但保留夹爪特异性精修模块,有效融合不同抓取模态的信息,提升在杂乱场景中的鲁棒性与适应性。实验表明,其性能在相关基准上可媲美单任务模型。在单臂多夹爪机器人的真实测试中,相比仅用吸盘基线,本方法抓取已见物体提升16%,新物体提升32%,且平行夹爪任务表现也具竞争力。
原文摘要 · Abstract (English)
Vision-based models for robotic grasping automate critical, repetitive, and draining industrial tasks. Existing approaches are typically limited in two ways: they either target a single gripper and are potentially applied on costly dual-arm setups, or rely on custom hybrid grippers that require ad-hoc learning procedures with logic that cannot be transferred across tasks, restricting their general applicability. In this work, we present MultiGraspNet, a novel multitask 3D deep learning method that predicts feasible poses simultaneously for parallel and vacuum grippers within a unified framework, enabling a single robot to handle multiple end effectors. The model is trained on the richly annotated GraspNet-1Billion and SuctionNet-1Billion datasets, which have been aligned for the purpose, and generates graspability masks quantifying the suitability of each scene point for successful grasps. By sharing early-stage features while maintaining gripper-specific refiners, MultiGraspNet effectively leverages complementary information across grasping modalities, enhancing robustness and adaptability in cluttered scenes. We characterize MultiGraspNet's performance with an extensive experimental analysis, demonstrating its competitiveness with single-task models on relevant benchmarks. We run real-world experiments on a single-arm multi-gripper robotic setup showing that our approach outperforms the vacuum baseline, grasping 16% percent more seen objects and 32% more of the novel ones, while obtaining competitive results for the parallel task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。