用动态感知的运动基元,让机器人精准扔环,实测胜过人类专家。
DA-MMP: Learning Coordinated and Accurate Throwing with Dynamics-Aware Motion Manifold Primitives
- 设计可变长度的动态感知运动基元,从规划数据中学习高质量轨迹流形。
- 仅需少量真实实验,生成考虑执行动态的协调抛掷轨迹,成功率超人类专家。
- 能泛化到训练外的新目标,适合复杂动态操作任务的机器人学习。
动态操作是提升机器人性能的关键能力,如投掷动作。尽管基于学习的方法已取得进展,多数仍依赖人工设计的动作参数化,难以生成复杂任务所需的高协调性动作。运动规划虽能生成可行轨迹,但因控制误差、接触不确定性和空气动力学效应等动态偏差,常导致规划与执行轨迹严重偏离。本文提出动态感知运动流形基元(DA-MMP),一种面向目标条件的动态操作运动生成框架,并在真实的环投任务中验证。通过紧凑参数化扩展运动流形基元以适应变长轨迹,并基于大规模规划轨迹数据集学习高质量流形。在此基础上,利用少量真实实验,在隐空间训练条件流匹配模型,生成考虑执行动态的抛掷轨迹。实验表明,该方法能生成协调平滑的环投轨迹;在真实场景中表现优异,成功率超过训练过的真人专家。此外,模型还能泛化至训练范围外的新目标,证明其成功学习了轨迹-动态映射关系。
原文摘要 · Abstract (English)
Dynamic manipulation is a key capability for advancing robot performance, enabling skills such as tossing. While recent learning-based approaches have pushed the field forward, most methods still rely on manually designed action parameterizations, limiting their ability to produce the highly coordinated motions required in complex tasks. Motion planning can generate feasible trajectories, but the dynamics gap-stemming from control inaccuracies, contact uncertainties, and aerodynamic effects-often causes large deviations between planned and executed trajectories. In this work, we propose Dynamics-Aware Motion Manifold Primitives (DA-MMP), a motion generation framework for goal-conditioned dynamic manipulation, and instantiate it on a challenging real-world ring-tossing task. Our approach extends motion manifold primitives to variable-length trajectories through a compact parameterization and learns a high-quality manifold from a large-scale dataset of planned motions. Building on this manifold, a conditional flow matching model is trained in the latent space with a small set of real-world trials, enabling the generation of throwing trajectories that account for execution dynamics. Experiments show that our method can generate coordinated and smooth motion trajectories for the ring-tossing task. In real-world evaluations, it achieves high success rates and even surpasses the performance of trained human experts. Moreover, it generalizes to novel targets beyond the training range, indicating that it successfully learns the underlying trajectory-dynamics mapping.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。