构建统一动态空间,让不同来源的人体运动数据协同建模
Homogeneous Dynamics Space for Heterogeneous Humans
- 从多源异构数据中提取共性,建立统一人体动力学表征空间
- 实现运动学与动力学间有效映射,提升数据驱动的动态理解能力
- 适合研究人体运动建模、跨领域数据融合的学者使用
人体运动学分析已取得显著进展,但其生成机制——人体动力学仍缺乏深入研究。本文指出,现有研究在运动表征、层次化动力学结构及数据来源(生物力学与强化学习)上存在显著异质性,成为阻碍发展的关键障碍。通过深入分析这些异质性,我们发现它们本质上反映的是同一事实:人体运动具有内在同质性。为此,提出同质动力学空间(HDyS),通过整合异构数据与训练一个同质潜在空间,借鉴逆-正向动力学过程构建基础表示。利用多源表征与数据集,HDyS实现了运动学与动力学间的有效映射。通过大量实验与应用验证了其可行性。
原文摘要 · Abstract (English)
Analyses of human motion kinematics have achieved tremendous advances. However, the production mechanism, known as human dynamics, is still undercovered. In this paper, we aim to push data-driven human dynamics understanding forward. We identify a major obstacle to this as the heterogeneity of existing human motion understanding efforts. Specifically, heterogeneity exists in not only the diverse kinematics representations and hierarchical dynamics representations but also in the data from different domains, namely biomechanics and reinforcement learning. With an in-depth analysis of the existing heterogeneity, we propose to emphasize the beneath homogeneity: all of them represent the homogeneous fact of human motion, though from different perspectives. Given this, we propose Homogeneous Dynamics Space (HDyS) as a fundamental space for human dynamics by aggregating heterogeneous data and training a homogeneous latent space with inspiration from the inverse-forward dynamics procedure. Leveraging the heterogeneous representations and datasets, HDyS achieves decent mapping between human kinematics and dynamics. We demonstrate the feasibility of HDyS with extensive experiments and applications. The project page is https://foruck.github.io/HDyS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。