用大模型自动生成机器人操作数据,实现零样本技能迁移。
BLAZER: Bootstrapping LLM-based Manipulation Agents with Zero-Shot Data Generation
- 利用大模型零样本规划能力自动生成仿真中的操作示范。
- 在仿真中训练后,直接迁移到真实传感器环境,性能显著提升。
- 无需人工标注,可降低大模型规模并拓展未训练任务泛化能力。
扩大数据和模型规模在计算机视觉和语言领域取得了显著进展。受此启发,机器人领域也尝试通过扩大数据与模型规模来提升策略的通用性和鲁棒性。然而,与视觉和语言不同,机器人缺乏互联网规模的操作示范数据。现有数据集通常依赖人工采集与整理。为此,本文提出BLAZER框架,通过自动生成训练数据学习操作策略。基于大模型的零样本规划能力,在仿真环境中自动生成多样化的操作示范。成功案例用于微调大模型并提升其规划能力,全程无需人工干预。值得注意的是,尽管训练依赖模拟器状态,但所学技能可直接迁移至基于传感器的真实操作。大量实验表明,BLAZER显著提升了模拟与真实环境中的零样本操作表现,并能泛化到训练外的任务,同时支持大模型降规模。代码与数据将公开发布。
原文摘要 · Abstract (English)
Scaling data and models has played a pivotal role in the remarkable progress of computer vision and language. Inspired by these domains, recent efforts in robotics have similarly focused on scaling both data and model size to develop more generalizable and robust policies. However, unlike vision and language, robotics lacks access to internet-scale demonstrations across diverse robotic tasks and environments. As a result, the scale of existing datasets typically suffers from the need for manual data collection and curation. To address this problem, here we propose BLAZER, a framework that learns manipulation policies from automatically generated training data. We build on the zero-shot capabilities of LLM planners and automatically generate demonstrations for diverse manipulation tasks in simulation. Successful examples are then used to finetune an LLM and to improve its planning capabilities without human supervision. Notably, while BLAZER training requires access to the simulator's state, we demonstrate direct transfer of acquired skills to sensor-based manipulation. Through extensive experiments, we show BLAZER to significantly improve zero-shot manipulation in both simulated and real environments. Moreover, BLAZER improves on tasks outside of its training pool and enables downscaling of LLM models. Our code and data will be made publicly available on the project page.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。