arXiv:2410.07554cs.RO2024-10ICRA被引 88

让机器人通过模仿人类施力动作,提升复杂抓握任务的完成率。

ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulation

  • 用施力-运动捕捉系统收集人类操作时的力觉数据
  • 相比纯视觉方法,蔬菜削皮成功率提升54.5%
  • 适合需要精细力控的机械臂操作场景

在多数接触密集型操作任务中,人类会施加随时间变化的力来补偿视觉引导下手部轨迹的误差。然而,当前机器人学习算法主要关注基于轨迹的策略,对力相关技能的学习关注有限。为此,我们提出ForceMimic,一个以力为中心的机器人学习系统,包含一种自然、力感知且无需机器人的示范采集系统,以及一种混合力-运动模仿学习算法,用于实现鲁棒的接触密集型操作。通过提出的ForceCapture系统,操作员可在5分钟内完成西葫芦削皮,而带力反馈的遥操作耗时超过13分钟且难以完成任务。利用采集的数据,我们提出HybridIL,训练一个以力为中心的模仿学习模型,配备混合力-位置控制原语,在机器人执行过程中拟合预测的力矩-位置参数。实验表明,该方法使模型在蔬菜削皮这一接触密集型任务中学习到更稳健的策略,相比最先进的纯视觉模仿学习方法,成功率达相对提升54.5%。硬件、代码、数据及更多结果详见项目网站:https://forcemimic.github.io。

原文摘要 · Abstract (English)

In most contact-rich manipulation tasks, humans apply time-varying forces to the target object, compensating for inaccuracies in the vision-guided hand trajectory. However, current robot learning algorithms primarily focus on trajectory-based policy, with limited attention given to learning force-related skills. To address this limitation, we introduce ForceMimic, a force-centric robot learning system, providing a natural, force-aware and robot-free robotic demonstration collection system, along with a hybrid force-motion imitation learning algorithm for robust contact-rich manipulation. Using the proposed ForceCapture system, an operator can peel a zucchini in 5 minutes, while force-feedback teleoperation takes over 13 minutes and struggles with task completion. With the collected data, we propose HybridIL to train a force-centric imitation learning model, equipped with hybrid force-position control primitive to fit the predicted wrench-position parameters during robot execution. Experiments demonstrate that our approach enables the model to learn a more robust policy under the contact-rich task of vegetable peeling, increasing the success rates by 54.5% relatively compared to state-ofthe-art pure-vision-based imitation learning. Hardware, code, data and more results can be found on the project website at https://forcemimic.github.io.

力控模仿学习机器人操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。