用技能库快速找到适合新装配任务的机器人策略,提升学习效率与成功率。
SRSA: Skill Retrieval and Adaptation for Robotic Assembly Tasks
- 基于技能库中已有策略的零样本成功率预测,智能挑选最相关技能。
- 在未见任务上成功率达90%,比基线提升19%相对成功率。
- 适合需要快速适应新装配任务的工业机器人研发人员。
让机器人以数据高效方式学习新任务是长期挑战。现有方法多依赖相关任务的过渡数据,但对高接触力装配任务研究较少。本文提出SRSA框架,利用预存的多样化装配任务策略库,通过预测各技能在新任务上的迁移成功率,指导技能检索。该框架联合建模物体几何、物理动力学和专家动作特征,实现高效迁移成功率预测。大量实验表明,相较于领先基线,SRSA在未见任务上实现19%的相对成功率提升,标准差降低2.6倍,达到满意成功率所需样本减少2.4倍;且在仿真中训练的策略部署至真实世界时,平均成功率可达90%。
原文摘要 · Abstract (English)
Enabling robots to learn novel tasks in a data-efficient manner is a long-standing challenge. Common strategies involve carefully leveraging prior experiences, especially transition data collected on related tasks. Although much progress has been made for general pick-and-place manipulation, far fewer studies have investigated contact-rich assembly tasks, where precise control is essential. We introduce SRSA (Skill Retrieval and Skill Adaptation), a novel framework designed to address this problem by utilizing a pre-existing skill library containing policies for diverse assembly tasks. The challenge lies in identifying which skill from the library is most relevant for fine-tuning on a new task. Our key hypothesis is that skills showing higher zero-shot success rates on a new task are better suited for rapid and effective fine-tuning on that task. To this end, we propose to predict the transfer success for all skills in the skill library on a novel task, and then use this prediction to guide the skill retrieval process. We establish a framework that jointly captures features of object geometry, physical dynamics, and expert actions to represent the tasks, allowing us to efficiently learn the transfer success predictor. Extensive experiments demonstrate that SRSA significantly outperforms the leading baseline. When retrieving and fine-tuning skills on unseen tasks, SRSA achieves a 19% relative improvement in success rate, exhibits 2.6x lower standard deviation across random seeds, and requires 2.4x fewer transition samples to reach a satisfactory success rate, compared to the baseline. Furthermore, policies trained with SRSA in simulation achieve a 90% mean success rate when deployed in the real world. Please visit our project webpage https://srsa2024.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。