无需微调,机器人可零样本适配新环境。
Robot Utility Models: General Policies for Zero-Shot Deployment in New Environments
- 用多模态模仿学习融合高效采集的数据训练通用策略。
- 在未见过的环境中平均达90%成功率,跨设备无须重训。
- 适合希望快速部署通用机器人的研究者与工程师。
近期大型数据训练的机器人模型展现出丰富的现实世界操作与导航能力。尽管已有研究证明,在特定环境中充分训练后,机器人策略可泛化至该环境中的变化场景,但为每个新环境进行微调仍与语言和视觉模型的零样本开放世界部署形成鲜明对比。本文提出机器人效用模型(RUMs)框架,实现无需任何微调的零样本机器人策略训练与部署,直接适应新环境。为高效构建RUMs,我们开发了移动操作任务的快速数据采集工具,将数据融入多模态模仿学习策略,并在低成本通用机器人Hello Robot Stretch上本地部署,结合外部mLLM验证器实现失败重试。我们训练了五类效用模型:开柜门、开抽屉、拾取餐巾、拾取纸袋、翻正倒落物体。系统在未见过的新环境中交互未见过物体时,平均成功率达90%。此外,这些模型在不同机器人和摄像头配置下也能成功,无需额外数据、训练或微调。主要经验包括:训练数据比算法与策略架构更重要,数据量需合理扩展,演示需多样化且高质量,并提供机器人自省与重试的实用方案。代码、数据、模型、硬件设计及实验视频均已开源,详见https://robotutilitymodels.com。
原文摘要 · Abstract (English)
Robot models, particularly those trained with large amounts of data, have recently shown a plethora of real-world manipulation and navigation capabilities. Several independent efforts have shown that given sufficient training data in an environment, robot policies can generalize to demonstrated variations in that environment. However, needing to finetune robot models to every new environment stands in stark contrast to models in language or vision that can be deployed zero-shot for open-world problems. In this work, we present Robot Utility Models (RUMs), a framework for training and deploying zero-shot robot policies that can directly generalize to new environments without any finetuning. To create RUMs efficiently, we develop new tools to quickly collect data for mobile manipulation tasks, integrate such data into a policy with multi-modal imitation learning, and deploy policies on-device on Hello Robot Stretch, a cheap commodity robot, with an external mLLM verifier for retrying. We train five such utility models for opening cabinet doors, opening drawers, picking up napkins, picking up paper bags, and reorienting fallen objects. Our system, on average, achieves 90% success rate in unseen, novel environments interacting with unseen objects. Moreover, the utility models can also succeed in different robot and camera set-ups with no further data, training, or fine-tuning. Primary among our lessons are the importance of training data over training algorithm and policy class, guidance about data scaling, necessity for diverse yet high-quality demonstrations, and a recipe for robot introspection and retrying to improve performance on individual environments. Our code, data, models, hardware designs, as well as our experiment and deployment videos are open sourced and can be found on our project website: https://robotutilitymodels.com
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。