让机器人先玩后装配,提升精密操作的样本效率与泛化能力。
Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?

- 通过多样化物体玩耍预训练,学习可复用的抓取、翻转等通用操作先验。
- 比从零开始强化学习快33倍,即使有密集奖励也更高效。
- 零样本迁移实现在0.5毫米间隙下60%的插入成功率,适合复杂装配任务。
多指机器人虽具有人类手部的速度与灵巧性,但精密装配等任务仍难以实现。此类任务接触频繁,导致模仿学习数据收集困难;奖励稀疏,使强化学习直接探索不可行。以往研究依赖专用夹爪、工具附件和环境工装来结构化问题。本文提出Play2Perfect框架,主张在精确实例装配前,机器人需先学会‘玩耍’。该框架通过在多样化物体与目标上进行无任务预训练,获取可复用的操控先验,如抓取、手内重定向和位姿到达。微调阶段将此通用先验适配至装配任务,聚焦于最终接触密集、高精度的交互。我们系统评估了玩耍预训练中的关键设计因素:物体多样性、训练目标、轨迹多样性与目标精度。结果显示,该先验比从零开始的强化学习样本效率高33倍,即便提供密集的多阶段奖励亦然。在模拟到现实的零样本迁移中,实现了仅0.5毫米接触间隙下的60%成功插入率,以及超过50%的长时程多部件装配与拧螺丝成功率。
原文摘要 · Abstract (English)
Multi-fingered robots promise the speed and dexterity of human hands, yet challenging problems such as precise assembly have remained out of reach. These tasks are contact-rich, making data collection for imitation learning difficult, and sparse-reward, making direct exploration with reinforcement learning (RL) intractable. Consequently, prior work has made progress by structuring the problem with specialized grippers, tool attachments, and environment fixtures. In this work, we argue that before a robot can perfect precise assembly, it must first learn to play. We further ask the question: what factors in the process of learning to play matter for precise assembly? We propose Play2Perfect, an RL framework for task-agnostic pretraining through play on diverse objects and goals, which is then perfected on precise assembly. The goal of play is to acquire reusable manipulation priors, such as grasping, in-hand reorientation and pose reaching. Finetuning then adapts this general prior to assembly, focusing exploration on the final contact-rich, high-precision interactions needed for success. We systematically study key design choices in play pretraining, including object diversity, training objective, trajectory diversity, and goal precision. We show that our prior is 33x more sample-efficient than RL training from scratch, even when provided with dense, multi-stage rewards. We demonstrate zero-shot sim-to-real transfer, achieving 60% success on tight insertions with only 0.5 mm contact clearance, and over 50% success on long-horizon multi-part assembly and screwing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。