arXiv:2412.02699cs.RO2024-12CVPR被引 23

用单一模型统一学习上千种物体的抓取策略,效果比现有方法更好。

UniGraspTransformer: Simplified Policy Distillation for Scalable Dexterous Robotic Grasping

  • 先用强化学习训练单个物体的抓取策略,再统一分馏到一个通用Transformer网络。
  • 在视觉设置下对已见、未见类别和完全新物体的抓取成功率分别提升3.5%~10.1%。
  • 支持千种物体、多种姿态,适合需要泛化能力的复杂机器人抓取场景。

我们提出UniGraspTransformer,一种基于Transformer的通用抓取网络,简化训练流程并提升可扩展性与性能。相比UniDexGrasp++等需多步训练的方法,UniGraspTransformer采用两阶段流程:首先对每个物体使用强化学习训练专属策略生成成功抓取轨迹;随后将这些轨迹统一分馏至单一通用网络。该方法可有效扩展,支持多达12个自注意力模块,处理数千种不同姿态的物体。在状态和视觉两种设置下均表现优异,能生成多样化抓取姿态,适应各类形状与朝向。实验表明,在视觉设置下,对已见物体、同类别未见物体及完全新物体的抓取成功率分别提升3.5%、7.7%和10.1%,显著优于当前最优方法UniDexGrasp++。

原文摘要 · Abstract (English)

We introduce UniGraspTransformer, a universal Transformer-based network for dexterous robotic grasping that simplifies training while enhancing scalability and performance. Unlike prior methods such as UniDexGrasp++, which require complex, multi-step training pipelines, UniGraspTransformer follows a streamlined process: first, dedicated policy networks are trained for individual objects using reinforcement learning to generate successful grasp trajectories; then, these trajectories are distilled into a single, universal network. Our approach enables UniGraspTransformer to scale effectively, incorporating up to 12 self-attention blocks for handling thousands of objects with diverse poses. Additionally, it generalizes well to both idealized and real-world inputs, evaluated in state-based and vision-based settings. Notably, UniGraspTransformer generates a broader range of grasping poses for objects in various shapes and orientations, resulting in more diverse grasp strategies. Experimental results demonstrate significant improvements over state-of-the-art, UniDexGrasp++, across various object categories, achieving success rate gains of 3.5%, 7.7%, and 10.1% on seen objects, unseen objects within seen categories, and completely unseen objects, respectively, in the vision-based setting. Project page: https://dexhand.github.io/UniGraspTransformer.

机器人抓取Transformer强化学习泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。