用少量示范生成动态任务数据,让机器人学会适应变化环境。
DynaMimicGen: A Data Generation Framework for Robot Learning of Dynamic Tasks
- 仅需少数人类示范,通过动态运动基元生成可泛化的动作轨迹。
- 在物体位置、场景变化时仍能实时调整轨迹,支持长时序接触任务。
- 适合机器人在复杂动态环境中进行模仿学习,减少人工标注成本。
学习鲁棒的抓取策略通常需要大量且多样的数据集,而数据收集过程耗时费力,尤其在动态环境中难以实现。本文提出可扩展的数据生成框架DynaMimicGen(D-MG),仅需少量人类示范即可支持动态任务的学习。D-MG首先将示范分割为有意义的子任务,再利用动态运动基元(DMPs)对行为进行适应性泛化,以应对新环境和动态变化。相比依赖静态假设或简单插值的方法,D-MG生成平滑、真实且任务一致的笛卡尔轨迹,可在执行过程中实时响应物体位姿、机器人状态或场景几何的变化。该方法适用于不同场景布局、物体实例和机器人配置,既可用于静态任务,也可处理高度动态的操纵任务。在包括立方体堆叠和将杯子放入抽屉在内的长时序、高接触密度基准测试中,基于D-MG生成数据训练的机器人代理表现出色,即使面对不可预测的环境变化也具备强鲁棒性。D-MG无需大量人工示范,实现在动态环境中的泛化能力,为高效、可扩展的自主机器人学习提供了有力方案。
原文摘要 · Abstract (English)
Learning robust manipulation policies typically requires large and diverse datasets, the collection of which is time-consuming, labor-intensive, and often impractical for dynamic environments. In this work, we introduce DynaMimicGen (D-MG), a scalable dataset generation framework that enables policy training from minimal human supervision while uniquely supporting dynamic task settings. Given only a few human demonstrations, D-MG first segments the demonstrations into meaningful sub-tasks, then leverages Dynamic Movement Primitives (DMPs) to adapt and generalize the demonstrated behaviors to novel and dynamically changing environments. Improving prior methods that rely on static assumptions or simplistic trajectory interpolation, D-MG produces smooth, realistic, and task-consistent Cartesian trajectories that adapt in real time to changes in object poses, robot states, or scene geometry during task execution. Our method supports different scenarios - including scene layouts, object instances, and robot configurations - making it suitable for both static and highly dynamic manipulation tasks. We show that robot agents trained via imitation learning on D-MG-generated data achieve strong performance across long-horizon and contact-rich benchmarks, including tasks like cube stacking and placing mugs in drawers, even under unpredictable environment changes. By eliminating the need for extensive human demonstrations and enabling generalization in dynamic settings, D-MG offers a powerful and efficient alternative to manual data collection, paving the way toward scalable, autonomous robot learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。