arXiv:2605.17120cs.CV2026-05中稿 · EMBC 2026被引 1

用视频无标记动作捕捉评估婴儿全身运动,助力早期发育异常筛查

Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants

论文配图:Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants
图 1 · 摘自论文原文
  • 对比三种先进姿态估计算法在婴儿视频上的表现
  • SAM 3D Body在三维重建中误差最小(19-28毫米)
  • 结果可辅助临床识别婴儿运动发育模式,适合早教与康复研究

婴儿运动障碍的早期识别依赖专家对自发运动的视觉评估,推动了自动化、客观替代方案的发展。本研究系统评估了三种前沿姿态估计算法(MeTRAbs-ACAE、SAM 3D Body、Sapiens)在100段视频、13次会话中8名婴儿的多视角无标记动作捕捉数据上的表现。通过重投影误差、几何一致性及经过普鲁克斯特对齐的三维位置误差量化关键点检测精度,并验证了将逆运动学框架适配婴儿数据的可行性。尽管Sapiens在重投影误差(22.8像素)和几何一致性(0.82)上最优,但SAM 3D Body在三维信息完整性上表现最佳,其普鲁克斯特对齐位置误差为19至28毫米。案例分析表明,基于SAM 3D估计构建的生物力学模型可有效区分临床专家识别出的典型运动模式。这些发现凸显了三维姿态估计在婴儿生物力学中的潜力与局限,为可扩展的视频化早期运动发育评估奠定了初步基础。

原文摘要 · Abstract (English)

arly identification of motor impairment in infancy relies on expert visual assessment of spontaneous movement, motivating the development of automated, objective alternatives. One promising approach is using computer vision, which benefits from high quality pose estimation from video. In this study, we systematically evaluated three state-of-the-art pose estimation frameworks (MeTRAbs-ACAE, SAM 3D Body, and Sapiens) on 100 videos over 13 sessions of 8 infants recorded with a multi-view markerless motion capture system. We quantified keypoint detection accuracy using reprojection error, geometric consistency, and Procrustes-aligned 3D position error, and demonstrated proof-of-concept for fitting an inverse kinematic framework to infant data. While Sapiens achieved the lowest reprojection error and highest geometric consistency of the methods evaluated (22.8 pixels and 0.82, respectively), SAM 3D Body provided the most comprehensive 3D information for kinematic reconstruction with Procrustes-aligned position errors of 19 to 28 mm. We demonstrate in a case comparison example that biomechanical models fit to SAM 3D estimates distinguish representative movement patterns in infants related to motor development, as identified by a clinical expert. Together, these findings highlight both the promise and current limitations of 3D pose estimation for infant biomechanics and establish preliminary groundwork for scalable, video-based assessment of early motor development.

动作捕捉婴儿发育计算机视觉生物力学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。