arXiv:2510.17101cs.GRcs.CV2025-10中稿 · SIGGRAPH被引 2

让惯性传感器捕捉不同体型人体动作,首次实现形状自适应的运动追踪。

Shape-aware Inertial Poser: Motion Tracking for Humans with Diverse Shapes Using Sparse Inertial Sensors

  • 分解传感器数据中的形状与姿态成分,建模其联合相关性。
  • 在10名儿童和10名成人上达到优于现有方法的追踪精度。
  • 首个支持惯性传感器估测身体形状的方法,适合多体型应用。

基于稀疏惯性传感器的人体动作捕捉近年受到广泛关注。然而,现有方法几乎都依赖模板成人体型来建模训练数据,难以泛化到体型差异显著的个体(如儿童)。这主要源于身体形状变化导致的惯性测量单元(IMU)加速度差异。为此,我们提出首个考虑体型差异的稀疏惯性动作捕捉方法——形状感知惯性姿势器(SAIP)。具体而言,通过分解与形状和姿态相关的传感器测量值,有效建模其联合相关性:首先训练回归模型,将真实人体的IMU加速度转换为模板成人体型的对应值,补偿形状相关测量;随后可沿用先进方法估计模板体的全身动作;最后利用第二个回归模型将关节速度映射回真实人体,并结合形状感知物理优化策略计算主体全局运动。此外,该方法引入首个基于惯性的形状估计方案,通过基于MLP的网络建模形状条件下的IMU-姿态相关性。为验证有效性,我们构建了首个包含不同体型个体的IMU动作捕捉数据集,包含10名儿童和10名成人,身高范围110~190厘米,共400分钟配对的IMU-动作样本。大量实验表明,SAIP能有效处理多样体型的动作捕捉任务。代码与数据集已开源。

原文摘要 · Abstract (English)

Human motion capture with sparse inertial sensors has gained significant attention recently. However, existing methods almost exclusively rely on a template adult body shape to model the training data, which poses challenges when generalizing to individuals with largely different body shapes (such as a child). This is primarily due to the variation in IMU-measured acceleration caused by changes in body shape. To fill this gap, we propose Shape-aware Inertial Poser (SAIP), the first solution considering body shape differences in sparse inertial-based motion capture. Specifically, we decompose the sensor measurements related to shape and pose in order to effectively model their joint correlations. Firstly, we train a regression model to transfer the IMU-measured accelerations of a real body to match the template adult body model, compensating for the shape-related sensor measurements. Then, we can easily follow the state-of-the-art methods to estimate the full body motions of the template-shaped body. Finally, we utilize a second regression model to map the joint velocities back to the real body, combined with a shape-aware physical optimization strategy to calculate global motions on the subject. Furthermore, our method relies on body shape awareness, introducing the first inertial shape estimation scheme. This is accomplished by modeling the shape-conditioned IMU-pose correlation using an MLP-based network. To validate the effectiveness of SAIP, we also present the first IMU motion capture dataset containing individuals of different body sizes. This dataset features 10 children and 10 adults, with heights ranging from 110 cm to 190 cm, and a total of 400 minutes of paired IMU-Motion samples. Extensive experimental results demonstrate that SAIP can effectively handle motion capture tasks for diverse body shapes. The code and dataset are available at https://github.com/yinlu5942/SAIP.

动作捕捉惯性传感器体型适配三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。