用手机视频就能测出人体运动和肌肉受力,适合临床筛查与康复评估。
OpenCap Monocular: 3D Human Kinematics and Musculoskeletal Dynamics from a Single Smartphone Video
- 基于单摄像头视频优化3D姿态,结合生物力学模型与物理仿真估算运动参数。
- 在坐站、下蹲等动作中,旋转误差仅4.8°,比传统方法提升近50%精度。
- 可精准估算膝关节力矩,适用于骨关节炎和衰弱人群的居家监测。
量化人体运动学(如步态)和肌骨骼动力学(如股四头肌受力)对于预测、治疗和监测移动障碍类疾病具有重要意义。然而,传统方法依赖昂贵且耗时的实验室设备,难以推广。我们提出 OpenCap Monocular,一种从单个智能手机视频中估计3D骨骼运动学与动力学的算法。该方法通过优化单目姿态估计模型(WHAM),构建符合生物力学约束的骨骼模型,结合物理仿真与机器学习计算动力学参数。在行走、深蹲和坐站任务中,其运动学误差为4.8°(旋转自由度均值绝对误差)、3.4 cm(骨盆平移),相比仅用回归的计算机视觉基线,旋转精度提升48%(p = 0.036),平移精度提升69%(p < 0.001)。此外,在步行过程中对地面反作用力的估计达到与双相机系统相当甚至更优的水平。算法成功实现了对坐站过渡中膝伸展力矩及行走时膝内收力矩的临床有意义估算,适用于衰弱与膝骨关节炎研究。OpenCap Monocular 已部署于手机应用、网页端与安全云端平台(https://opencap.ai),支持免费、便捷的单手机生物力学评估。
原文摘要 · Abstract (English)
Quantifying human movement (kinematics) and musculoskeletal forces (kinetics) at scale, such as estimating quadriceps force during a sit-to-stand movement, could transform prediction, treatment, and monitoring of mobility-related conditions. However, quantifying kinematics and kinetics traditionally requires costly, time-intensive analysis in specialized laboratories, limiting clinical translation. Scalable, accurate tools for biomechanical assessment are needed. We introduce OpenCap Monocular, an algorithm that estimates 3D skeletal kinematics and kinetics from a single smartphone video. The method refines 3D human pose estimates from a monocular pose estimation model (WHAM) via optimization, computes kinematics of a biomechanically constrained skeletal model, and estimates kinetics via physics-based simulation and machine learning. We validated OpenCap Monocular against marker-based motion capture and force plate data for walking, squatting, and sit-to-stand tasks. OpenCap Monocular achieved low kinematic error (4.8° mean absolute error for rotational degrees of freedom; 3.4 cm for pelvis translations), outperforming a regression-only computer vision baseline by 48% in rotational accuracy (p = 0.036) and 69% in translational accuracy (p < 0.001). OpenCap Monocular also estimated ground reaction forces during walking with accuracy comparable to, or better than, our prior two-camera OpenCap system. We demonstrate that the algorithm estimates important kinetic outcomes with clinically meaningful accuracy in applications related to frailty and knee osteoarthritis, including estimating knee extension moment during sit-to-stand transitions and knee adduction moment during walking. OpenCap Monocular is deployed via a smartphone app, web app, and secure cloud computing (https://opencap.ai), enabling free, accessible single-smartphone biomechanical assessments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。