用人类画的2D草图生成机器人轨迹,实现零成本启动机械臂学习。
Sketch-to-Skill: Bootstrapping Robot Learning with Human Drawn Trajectory Sketches
- 将手绘2D草图转为3D运动轨迹,自动生成初始演示数据。
- 仅靠草图训练,性能达到遥操作数据的96%,比纯强化学习高170%。
- 适合无专家数据的场景,降低机器人学习门槛。
传统机器人操作策略训练需大量示范或环境交互。尽管近期模仿学习(IL)与强化学习(RL)减少了示范需求,仍依赖专家收集高质量数据,限制可扩展性。本文提出Sketch-to-Skill框架,利用人类绘制的2D轨迹草图引导机器人强化学习。通过草图到3D轨迹生成器,将2D草图转化为3D运动轨迹,并用于自主收集初始示范。这些生成数据既用于行为克隆预训练初始策略,也用于带引导探索的强化学习优化。实验表明,该方法仅基于草图输入,性能达到遥操作示范基线的约96%,比纯强化学习高出约170%。显著提升了机器人操作学习的可及性与应用潜力。
原文摘要 · Abstract (English)
Training robotic manipulation policies traditionally requires numerous demonstrations and/or environmental rollouts. While recent Imitation Learning (IL) and Reinforcement Learning (RL) methods have reduced the number of required demonstrations, they still rely on expert knowledge to collect high-quality data, limiting scalability and accessibility. We propose Sketch-to-Skill, a novel framework that leverages human-drawn 2D sketch trajectories to bootstrap and guide RL for robotic manipulation. Our approach extends beyond previous sketch-based methods, which were primarily focused on imitation learning or policy conditioning, limited to specific trained tasks. Sketch-to-Skill employs a Sketch-to-3D Trajectory Generator that translates 2D sketches into 3D trajectories, which are then used to autonomously collect initial demonstrations. We utilize these sketch-generated demonstrations in two ways: to pre-train an initial policy through behavior cloning and to refine this policy through RL with guided exploration. Experimental results demonstrate that Sketch-to-Skill achieves ~96% of the performance of the baseline model that leverages teleoperated demonstration data, while exceeding the performance of a pure reinforcement learning policy by ~170%, only from sketch inputs. This makes robotic manipulation learning more accessible and potentially broadens its applications across various domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。