用物理模型将人体动作数据转为机器人可执行的高精度动作,提升训练效率。
SPIDER: Scalable Physics-Informed Dexterous Retargeting
- 基于物理的分阶段优化,用虚拟接触引导生成动态可行轨迹。
- 在9种机器人上成功应用,成功率提升18%,比强化学习快10倍。
- 适合需要大量高质量动作数据的机器人控制研究者使用。
人类动作数据虽丰富,但因身体差异和缺乏力矩等动态信息,无法直接用于机器人控制。为此,我们提出可扩展的物理引导灵巧操作重定向框架SPIDER,将仅含运动学的人体示范转化为大规模动态可行的机器人轨迹。核心思想是:人体示范提供全局任务结构,通过课程式虚拟接触引导的物理采样精细优化轨迹,确保动力学可行性与正确接触序列。SPIDER可适配9种人形与灵巧手机器人及6个数据集,在标准采样基础上提升18%成功率,速度达强化学习基线的10倍,并生成240万帧动态可行的机器人数据集,支持高效策略学习。
原文摘要 · Abstract (English)
Learning dexterous and agile policy for humanoid and dexterous hand control requires large-scale demonstrations, but collecting robot-specific data is prohibitively expensive. In contrast, abundant human motion data is readily available from motion capture, videos, and virtual reality, which could help address the data scarcity problem. However, due to the embodiment gap and missing dynamic information like force and torque, these demonstrations cannot be directly executed on robots. To bridge this gap, we propose Scalable Physics-Informed DExterous Retargeting (SPIDER), a physics-based retargeting framework to transform and augment kinematic-only human demonstrations to dynamically feasible robot trajectories at scale. Our key insight is that human demonstrations should provide global task structure and objective, while large-scale physics-based sampling with curriculum-style virtual contact guidance should refine trajectories to ensure dynamical feasibility and correct contact sequences. SPIDER scales across diverse 9 humanoid/dexterous hand embodiments and 6 datasets, improving success rates by 18% compared to standard sampling, while being 10X faster than reinforcement learning (RL) baselines, and enabling the generation of a 2.4M frames dynamic-feasible robot dataset for policy learning. As a universal physics-based retargeting method, SPIDER can work with diverse quality data and generate diverse and high-quality data to enable efficient policy learning with methods like RL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。