arXiv:2503.03045cs.ROcs.AI2025-03中稿 · RSS 2025被引 17

一个策略搞定各类未知铰链物体开合,真实机器人零样本迁移成功。

ArticuBot: Learning Universal Articulated Object Manipulation Policy via Large Scale Simulation

  • 仿真生成42.3万条演示,用点云神经网络学策略
  • 分层策略提升泛化能力,新结构模型表现更优
  • 跨实验室、桌面与移动机器人,零样本开锁开门

本文提出ArticuBot,一种通过大规模物理仿真学习的通用铰链物体操作策略。系统由三部分组成:在仿真中生成大量示范,通过模仿学习将42.3万条示范压缩为基于点云的神经策略,实现零样本模拟到现实的迁移。采用采样式抓取与运动规划,示范生成高效。提出新型分层策略:高层策略预测末端执行器子目标,低层策略根据目标控制移动。该结构显著优于非分层版本。进一步设计加权位移模型,将预测锚定于场景三维结构,性能超越其他表示。实验表明,该策略可零样本迁移到三种真实机器人平台:固定桌面上的Franka机械臂(跨两实验室)、带移动基座的X-Arm,在两个实验室、客厅和厨房中成功开启多种未见铰链物体。视频与代码详见项目主页:https://articubot.github.io/。

原文摘要 · Abstract (English)

This paper presents ArticuBot, in which a single learned policy enables a robotics system to open diverse categories of unseen articulated objects in the real world. This task has long been challenging for robotics due to the large variations in the geometry, size, and articulation types of such objects. Our system, Articubot, consists of three parts: generating a large number of demonstrations in physics-based simulation, distilling all generated demonstrations into a point cloud-based neural policy via imitation learning, and performing zero-shot sim2real transfer to real robotics systems. Utilizing sampling-based grasping and motion planning, our demonstration generalization pipeline is fast and effective, generating a total of 42.3k demonstrations over 322 training articulated objects. For policy learning, we propose a novel hierarchical policy representation, in which the high-level policy learns the sub-goal for the end-effector, and the low-level policy learns how to move the end-effector conditioned on the predicted goal. We demonstrate that this hierarchical approach achieves much better object-level generalization compared to the non-hierarchical version. We further propose a novel weighted displacement model for the high-level policy that grounds the prediction into the existing 3D structure of the scene, outperforming alternative policy representations. We show that our learned policy can zero-shot transfer to three different real robot settings: a fixed table-top Franka arm across two different labs, and an X-Arm on a mobile base, opening multiple unseen articulated objects across two labs, real lounges, and kitchens. Videos and code can be found on our project website: https://articubot.github.io/.

机器人操作仿真训练零样本迁移分层策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。