仅用一次静态示范,实现机器人动态抓取的高效学习与实时响应。
DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration

- 从单个静态示范生成多样动态演示,大幅降低数据需求。
- 动态自适应策略根据任务变化调整推理频率,成功率提升18.4个百分点。
- 构建了可自动评估的动态操作基准,适合真实场景机器人研发者使用。
动态操作是机器人在复杂动态环境中执行任务的关键能力,但其学习面临两大挑战:一是动态场景组合复杂导致数据需求量大;二是动态变化迅速要求实时精准执行。本文提出DynamicManip,通过高效的数据增强管道和低延迟模仿策略应对上述问题。首先,设计静态转动态的数据增强流程,仅需一个静态示范即可生成多样化的动态操作示范。其次,提出动态感知自适应策略,依据任务动态变化调节推理频率,实现快速响应与高效操作。第三,构建了一个包含多样化动态任务的基准测试集,并配备自动化评估系统,支持可扩展、一致的性能评测。仿真与真实世界中的大量实验表明,DynamicManip在数据效率上显著提升,动态操作成功率平均提高18.4个百分点,策略查询延迟降低32.9%。
原文摘要 · Abstract (English)
Dynamic manipulation is a critical capability for robots operating in complex and dynamic environments, where robots must interact with objects that are moving or require rapid adjustments. However, learning models for dynamic manipulation tasks face two major challenges: (1) the combinatorial complexity of dynamic scenarios leads to substantial data requirements, and (2) rapid variations in dynamics require real-time and accurate policy execution. In this paper, we propose DynamicManip to address these challenges through an efficient data augmentation pipeline and a low-latency imitation policy. We first propose a static-to-dynamic augmentation pipeline that synthesizes diverse dynamic manipulation demonstrations from a single static demonstration. Second, we introduce a dynamic-aware adaptive policy that adjusts its inference frequency according to task dynamics, enabling responsive and effective dynamic manipulation. Third, we build a dynamic manipulation benchmark, which includes diverse dynamic tasks with an automatic evaluation system for scalable and consistent assessment. Extensive experiments in both simulation and the real world demonstrate that DynamicManip not only provides significant improvements in data efficiency but also achieves better performance in dynamic manipulation tasks, with a mean success rate 18.4 percentage points higher and policy-query latency 32.9% lower.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。