arXiv:2506.11786cs.LG2025-06被引 7

用惯性传感器实时估测人体运动动力学,无需真实标签。

SSPINNpose: A Self-Supervised PINN for Inertial Pose and Dynamics Estimation

  • 自监督物理感知网络,直接从惯性数据推断关节运动与受力。
  • 步行跑步速度达4.9米/秒时,关节角度误差仅8.7度,力矩误差4.9%BWBH%。
  • 适用于稀疏传感器配置,可自动推断传感器位置,适合临床与户外场景。

准确的实时人体运动动力学估计(包括关节力矩和肌肉力)对临床诊断和运动表现监测至关重要。惯性测量单元(IMUs)提供了一种低侵入式方案,尤其在稀疏传感器配置下表现良好。然而,现有实时方法依赖于监督学习,需借助光学运动捕捉等实验室系统获取真值数据,这些系统易引入测量与处理误差,且难以泛化到真实世界或未见过的动作,导致数据收集耗时且不切实际。为此,我们提出SSPINNpose,一种自监督的物理信息神经网络,可直接从IMU数据中估计关节运动学与动力学,无需真值标签训练。通过将网络输出输入人体物理模型以优化物理合理性,并生成虚拟传感器数据,网络直接在实测传感器数据上训练。相比光学运动捕捉,SSPINNpose在步行与跑步速度达4.9米/秒时,关节角与关节力矩的均方根误差分别为8.7°和4.9%BWBH%,延迟仅为3.5毫秒。该框架在稀疏传感器配置下仍具鲁棒性,可推断传感器解剖位置。结果表明,SSPINNpose是实验室与野外环境中实时生物力学分析的可扩展、自适应解决方案。

原文摘要 · Abstract (English)

Accurate real-time estimation of human movement dynamics, including internal joint moments and muscle forces, is essential for applications in clinical diagnostics and sports performance monitoring. Inertial measurement units (IMUs) provide a minimally intrusive solution for capturing motion data, particularly when used in sparse sensor configurations. However, current real-time methods rely on supervised learning, where a ground truth dataset needs to be measured with laboratory measurement systems, such as optical motion capture. These systems are known to introduce measurement and processing errors and often fail to generalize to real-world or previously unseen movements, necessitating new data collection efforts that are time-consuming and impractical. To overcome these limitations, we propose SSPINNpose, a self-supervised, physics-informed neural network that estimates joint kinematics and kinetics directly from IMU data, without requiring ground truth labels for training. We run the network output through a physics model of the human body to optimize physical plausibility and generate virtual measurement data. Using this virtual sensor data, the network is trained directly on the measured sensor data instead of a ground truth. When compared to optical motion capture, SSPINNpose is able to accurately estimate joint angles and joint moments at an RMSD of 8.7 deg and 4.9 BWBH%, respectively, for walking and running at speeds up to 4.9 m/s at a latency of 3.5 ms. Furthermore, the framework demonstrates robustness across sparse sensor configurations and can infer the anatomical locations of the sensors. These results underscore the potential of SSPINNpose as a scalable and adaptable solution for real-time biomechanical analysis in both laboratory and field environments.

人体运动惯性传感自监督学习物理模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。