arXiv:2410.17610cs.AIcs.CV2024-10ICLR被引 9

用模仿学习生成数据,训练出能估测人体关节力矩的新模型。

ImDy: Human Inverse Dynamics from Imitated Observations

  • 借助先进动作模仿算法与物理仿真,构建大规模动力学数据集。
  • 在150小时数据上训练的模型可同步估计关节力矩与地面反作用力。
  • 无需实验室设备,适合广泛运动分析与下游应用。

逆动力学(ID)旨在从人体运动学观测中还原驱动扭矩,是步态分析的关键工具。然而,传统基于优化的方法依赖昂贵实验设备,难以推广至一般运动。为此,我们提出利用先进的动作模仿算法,以数据驱动方式学习人体逆动力学。核心思想是:动作模仿器虽未直接输出力矩,但隐含了相关知识。据此,我们设计高效数据采集流程,结合前沿模仿算法与物理仿真,构建大规模人体逆动力学基准数据集ImDy,包含超过150小时的动作序列及对应关节力矩与全身地面反作用力数据。基于ImDy,我们训练了全监督的数据驱动逆动力学求解器ImDyS,可同时完成逆动力学与地面反作用力估计。在ImDy及真实数据上的实验表明,ImDyS在人体逆动力学与地面反作用力估计方面表现优异。此外,ImDy(-S)在下游应用中展现出作为基础运动分析工具的潜力。

原文摘要 · Abstract (English)

Inverse dynamics (ID), which aims at reproducing the driven torques from human kinematic observations, has been a critical tool for gait analysis. However, it is hindered from wider application to general motion due to its limited scalability. Conventional optimization-based ID requires expensive laboratory setups, restricting its availability. To alleviate this problem, we propose to exploit the recently progressive human motion imitation algorithms to learn human inverse dynamics in a data-driven manner. The key insight is that the human ID knowledge is implicitly possessed by motion imitators, though not directly applicable. In light of this, we devise an efficient data collection pipeline with state-of-the-art motion imitation algorithms and physics simulators, resulting in a large-scale human inverse dynamics benchmark as Imitated Dynamics (ImDy). ImDy contains over 150 hours of motion with joint torque and full-body ground reaction force data. With ImDy, we train a data-driven human inverse dynamics solver ImDyS(olver) in a fully supervised manner, which conducts ID and ground reaction force estimation simultaneously. Experiments on ImDy and real-world data demonstrate the impressive competency of ImDyS in human inverse dynamics and ground reaction force estimation. Moreover, the potential of ImDy(-S) as a fundamental motion analysis tool is exhibited with downstream applications. The project page is https://foruck.github.io/ImDy/.

逆动力学动作模仿数据驱动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。