让机器人在新环境里自动找到合适位置,让预训练抓取策略能顺利工作。
Mobi-$π$: Mobilizing Your Robot Learning Policy
- 通过优化机器人基座位置,使其匹配预训练策略的分布
- 在仿真和真实场景中均显著优于基线方法
- 无需额外演示,适合移动机器人精准操作任务
学习到的视觉-运动策略能执行日益复杂的操作任务,但大多在有限机器人位姿和相机视角下训练,导致对新位置泛化能力差,限制其在移动平台上的应用,尤其在按按钮、拧水龙头等精细任务中。本文提出策略移动化问题:在新环境中找到一个与训练策略分布一致的机器人基座位姿。相比重新训练策略以增强对未见基座初始化的鲁棒性,策略移动化将导航与操作解耦,无需额外示范。本方法利用3D高斯泼溅进行新视角合成,通过评分函数评估位姿适配度,并采用采样优化确定最优机器人位姿。我们还构建了Mobi-π框架,包含:(1) 量化策略移动化难度的指标,(2) 基于RoboCasa的模拟移动操作任务集,(3) 可视化分析工具。在自建仿真任务和真实世界中,所提方法均显著优于基线,验证了其有效性。
原文摘要 · Abstract (English)
Learned visuomotor policies are capable of performing increasingly complex manipulation tasks. However, most of these policies are trained on data collected from limited robot positions and camera viewpoints. This leads to poor generalization to novel robot positions, which limits the use of these policies on mobile platforms, especially for precise tasks like pressing buttons or turning faucets. In this work, we formulate the policy mobilization problem: find a mobile robot base pose in a novel environment that is in distribution with respect to a manipulation policy trained on a limited set of camera viewpoints. Compared to retraining the policy itself to be more robust to unseen robot base pose initializations, policy mobilization decouples navigation from manipulation and thus does not require additional demonstrations. Crucially, this problem formulation complements existing efforts to improve manipulation policy robustness to novel viewpoints and remains compatible with them. We propose a novel approach for policy mobilization that bridges navigation and manipulation by optimizing the robot's base pose to align with an in-distribution base pose for a learned policy. Our approach utilizes 3D Gaussian Splatting for novel view synthesis, a score function to evaluate pose suitability, and sampling-based optimization to identify optimal robot poses. To understand policy mobilization in more depth, we also introduce the Mobi-$π$ framework, which includes: (1) metrics that quantify the difficulty of mobilizing a given policy, (2) a suite of simulated mobile manipulation tasks based on RoboCasa to evaluate policy mobilization, and (3) visualization tools for analysis. In both our developed simulation task suite and the real world, we show that our approach outperforms baselines, demonstrating its effectiveness for policy mobilization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。