arXiv:2410.06911cs.ROcs.AI2024-10被引 7

用分层规划+扩散模型,让机器人长距离推拉未知动态的物体。

Combining Planning and Diffusion for Mobility with Unknown Dynamics

  • 先规划路径生成目标点序列,再用扩散模型逐点执行
  • 10次实验成功8次,远超单一扩散或刚性假设方法
  • 无需再训练即可适应新环境、新椅子和不同地面

在仓库等场景中,对大物体进行长时间操作是可部署机器人系统的关键能力。这类任务涉及移动操作,需同时完成抓取、导航与拖动物体。现实场景中,物体动力学极为复杂,如带旋转底座和五个万向轮的办公椅与地面的相互作用。本文提出一种分层算法,用于解决动力学部分未知的长期机器人操作问题。我们发现,基于扩散的行为克隆在短时任务中表现优异,因此将问题分解为抽象的高层、避障路径规划,生成一系列目标点;再使用短时相对运动扩散策略依次达成这些目标点。我们在配备机械臂的Spot机器人上训练了移动操作策略,使其推拉办公椅。相比直接训练长时扩散策略或假设物体刚性连接的方法,本方案在更长任务中表现更优:10次测试中成功8次,而对比方法分别为0次和5次。重要的是,该学习策略无需额外训练即可泛化到新布局、新抓取方式、新椅子及高摩擦地面,展现出在其他复杂移动操作任务中的潜力。

原文摘要 · Abstract (English)

Manipulation of large objects over long horizons (such as carts in a warehouse) is an essential skill for deployable robotic systems. Large objects require mobile manipulation which involves simultaneous manipulation, navigation, and movement with the object in tow. In many real-world situations, object dynamics are incredibly complex, such as the interaction of an office chair (with a rotating base and five caster wheels) and the ground. We present a hierarchical algorithm for long-horizon robot manipulation problems in which the dynamics are partially unknown. We observe that diffusion-based behavior cloning is highly effective for short-horizon problems with unknown dynamics, so we decompose the problem into an abstract high-level, obstacle-aware motion-planning problem that produces a waypoint sequence. We use a short-horizon, relative-motion diffusion policy to achieve the waypoints in sequence. We train mobile manipulation policies on a Spot robot that has to push and pull an office chair. Our hierarchical manipulation policy performs consistently better, especially when the horizon increases, compared to a diffusion policy trained on long-horizon demonstrations or motion planning assuming a rigidly-attached object (success rate of 8 (versus 0 and 5 respectively) out of 10 runs). Importantly, our learned policy generalizes to new layouts, grasps, chairs, and flooring that induces more friction, without any further training, showing promise for other complex mobile manipulation problems. Project Page: https://yravan.github.io/plannerorderedpolicy/

移动操作扩散模型分层规划长时任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。