arXiv:2409.15585cs.RO2024-09ICRA被引 2

让机器人在未见过的形态下也能零样本规划运动路径。

XMoP: Whole-Body Control Policy for Zero-shot Cross-Embodiment Neural Motion Planning

  • 用百万级仿真机器人训练全身控制策略,隐式学习多种机械臂的运动约束。
  • 在7款商用机械臂上实现平均70%成功率的跨形态运动规划。
  • 无需重新训练,直接部署到真实世界新机械臂,应对动态障碍挑战。

传统机械臂运动规划器可在不同机器人形态间通用,但依赖预设静态环境表示,难以扩展至未见过的动态环境。神经运动规划器(NMPs)可直接从原始传感器观测中学习运动策略,融合环境约束。现有最优NMPs虽能在不同环境中成功规划,但无法跨机器人形态泛化。本文提出跨形态运动策略XMoP,通过在超过三百万种程序生成的机器人形态与模拟环境中训练全身控制策略,实现对一系列机器人的零样本迁移。该策略在完全合成数据上训练,却能以单一冻结参数集,在具有不同运动学结构和自由度的多种机械臂上实现强仿真到现实的泛化。我们在7款商用机械臂上验证了效果,基准测试平均成功率达70%;并进一步在两个未见过的真实机械臂上,于三个实际场景中成功解决含动态障碍的新规划任务。

原文摘要 · Abstract (English)

Classical manipulator motion planners work across different robot embodiments. However they plan on a pre-specified static environment representation, and are not scalable to unseen dynamic environments. Neural Motion Planners (NMPs) are an appealing alternative to conventional planners as they incorporate different environmental constraints to learn motion policies directly from raw sensor observations. Contemporary state-of-the-art NMPs can successfully plan across different environments. However none of the existing NMPs generalize across robot embodiments. In this paper we propose Cross-Embodiment Motion Policy (XMoP), a neural policy for learning to plan over a distribution of manipulators. XMoP implicitly learns to satisfy kinematic constraints for a distribution of robots and $\textit{zero-shot}$ transfers the planning behavior to unseen robotic manipulators within this distribution. We achieve this generalization by formulating a whole-body control policy that is trained on planning demonstrations from over three million procedurally sampled robotic manipulators in different simulated environments. Despite being completely trained on synthetic embodiments and environments, our policy exhibits strong sim-to-real generalization across manipulators with different kinematic variations and degrees of freedom with a single set of frozen policy parameters. We evaluate XMoP on $7$ commercial manipulators and show successful cross-embodiment motion planning, achieving an average $70\%$ success rate on baseline benchmarks. Furthermore, we demonstrate our policy sim-to-real on two unseen manipulators solving novel planning problems across three real-world domains even with dynamic obstacles.

运动规划跨形态神经控制零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。