用仿真生成可扩展的柔体操作数据,让机器人学会穿线、折叠等复杂动作。
SoftMimicGen: A Data Generation System for Scalable Robot Learning in Deformable Object Manipulation
- 构建高保真柔体仿真环境,支持多种物体与机械臂形态
- 生成包含4类物体、12种操作的合成数据集,训练出高性能策略
- 适用于需要复杂柔体操作的机器人研发,如医疗手术和家务服务
大规模机器人数据集推动了各类操作技能的学习,但其收集成本高昂,难以扩展。仿真与合成数据生成成为替代方案,尤其在减少真实数据需求、提升泛化能力方面表现优异。然而,现有方法主要限于刚体任务,难以模拟柔体操作。本文提出SoftMimicGen,一个面向柔体操作任务的自动化数据生成系统。构建了涵盖布偶、绳索、纸巾、毛巾等四类柔体物体,以及高精度穿线、动态甩动、折叠、抓取放置等行为的高保真仿真环境,适配单臂、双臂、人形机器人及手术机器人四种机械臂形态。利用SoftMimicGen生成多任务数据集,训练出高性能策略,并系统分析了生成系统的有效性。项目官网:https://softmimicgen.github.io。
原文摘要 · Abstract (English)
Large-scale robot datasets have facilitated the learning of a wide range of robot manipulation skills, but these datasets remain difficult to collect and scale further, owing to the intractable amount of human time, effort, and cost required. Simulation and synthetic data generation have proven to be an effective alternative to fuel this need for data, especially with the advent of recent work showing that such synthetic datasets can dramatically reduce real-world data requirements and facilitate generalization to novel scenarios unseen in real-world demonstrations. However, this paradigm has been limited to rigid-body tasks, which are easy to simulate. Deformable object manipulation encompasses a large portion of real-world manipulation and remains a crucial gap to address towards increasing adoption of the synthetic simulation data paradigm. In this paper, we introduce SoftMimicGen, an automated data generation pipeline for deformable object manipulation tasks. We introduce a suite of high-fidelity simulation environments that encompasses a wide range of deformable objects (stuffed animal, rope, tissue, towel) and manipulation behaviors (high-precision threading, dynamic whipping, folding, pick-and-place), across four robot embodiments: a single-arm manipulator, bimanual arms, a humanoid, and a surgical robot. We apply SoftMimicGen to generate datasets across the task suite, train high-performing policies from the data, and systematically analyze the data generation system. Project website: \href{https://softmimicgen.github.io}{softmimicgen.github.io}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。