自动生成机器人装配所需的仿真兼容零件对,解决人工设计资产的瓶颈。
MatchMaker: Automated Asset Generation for Robotic Assembly
- 输入不兼容零件对或单个零件,自动生成可仿真、无穿透的装配对。
- 通过指定间隙参数自动优化接触面,生成真实感强的零件。
- 显著提升装配技能学习的数据多样性与有效性,适合通用装配任务研究者。
机器人装配因视觉感知复杂、抓取功能要求高、接触密集操作及高精度任务而面临挑战。基于仿真的学习和仿真到现实的迁移虽在处理物体位姿变化、感知噪声和控制误差方面取得进展,但通用(多任务)装配智能体的发展受限于人工设计装配资产的繁琐,极大限制了可用于策略学习的装配问题数量与多样性。受生成式AI推动机器人学习规模化的启发,我们提出MatchMaker,一个自动化生成多样且仿真兼容装配资产对的流程。具体而言,MatchMaker可:1)将仿真不兼容、相互穿透的资产对自动转换为无穿透、可仿真的配对;2)以任意单个资产为输入,生成几何匹配的另一资产形成装配对;3)根据用户指定的间隙参数,自动侵蚀(1)或(2)中接触面,生成更真实的零件。实验表明,MatchMaker生成的数据在多样性与下游装配技能学习效果上优于现有方法。视频与更多细节请见项目网站:https://wangyian-me.github.io/MatchMaker/
原文摘要 · Abstract (English)
Robotic assembly remains a significant challenge due to complexities in visual perception, functional grasping, contact-rich manipulation, and performing high-precision tasks. Simulation-based learning and sim-to-real transfer have led to recent success in solving assembly tasks in the presence of object pose variation, perception noise, and control error; however, the development of a generalist (i.e., multi-task) agent for a broad range of assembly tasks has been limited by the need to manually curate assembly assets, which greatly constrains the number and diversity of assembly problems that can be used for policy learning. Inspired by recent success of using generative AI to scale up robot learning, we propose MatchMaker, a pipeline to automatically generate diverse, simulation-compatible assembly asset pairs to facilitate learning assembly skills. Specifically, MatchMaker can 1) take a simulation-incompatible, interpenetrating asset pair as input, and automatically convert it into a simulation-compatible, interpenetration-free pair, 2) take an arbitrary single asset as input, and generate a geometrically-mating asset to create an asset pair, 3) automatically erode contact surfaces from (1) or (2) according to a user-specified clearance parameter to generate realistic parts. We demonstrate that data generated by MatchMaker outperforms previous work in terms of diversity and effectiveness for downstream assembly skill learning. For videos and additional details, please see our project website: https://wangyian-me.github.io/MatchMaker/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。