arXiv:2409.10175cs.CV2024-09被引 3

用MoveNet改进的2D跑步动作捕捉系统,低成本实现步态分析。

VideoRun2D: Cost-Effective Markerless Motion Capture for Sprint Biomechanics

  • 基于MoveNet改进,结合人体生物力学约束优化追踪
  • 髋膝角误差3.2°~5.5°,躯干倾角跟踪效果良好
  • 适合科研或训练场景,高精度需求仍需优化

短跑是团队运动中的关键能力。以往研究多采用专门设计的人体生物力学方法分析跑步运动学,其中无标记系统成本较低。当前基于机器学习的通用像素与人体追踪方法表现优异,但通常未考虑真实人体生物力学特性。本研究首先将两种通用追踪器(MoveNet和CoTracker)适配用于真实生物力学分析,并与人工标注(使用Kinovea软件手动标记关键点)进行对比。我们提出的专为短跑生物力学优化的无标记追踪系统称为VideoRun2D。在40次短跑视频(5名受试者拍摄)上评估,重点关注三个关键角度:躯干倾斜角、髋关节屈伸角和膝关节屈伸角。CoTracker方法与人工标注差异显著,而MoveNet方法角度曲线估计准确,误差范围为3.2°至5.5°。结论表明,基于MoveNet核心的VideoRun2D可作为某些场景下评估短跑运动学的实用工具。然而,该版本的精度尚不足以满足高要求应用,未来方向包括改进后处理及用户与时间自适应机制。

原文摘要 · Abstract (English)

Sprinting is a determinant ability, especially in team sports. The kinematics of the sprint have been studied in the past using different methods specially developed considering human biomechanics and, among those methods, markerless systems stand out as very cost-effective. On the other hand, we have now multiple general methods for pixel and body tracking based on recent machine learning breakthroughs with excellent performance in body tracking, but these excellent trackers do not generally consider realistic human biomechanics. This investigation first adapts two of these general trackers (MoveNet and CoTracker) for realistic biomechanical analysis and then evaluate them in comparison to manual tracking (with key points manually marked using the software Kinovea). Our best resulting markerless body tracker particularly adapted for sprint biomechanics is termed VideoRun2D. The experimental development and assessment of VideoRun2D is reported on forty sprints recorded with a video camera from 5 different subjects, focusing our analysis in 3 key angles in sprint biomechanics: inclination of the trunk, flex extension of the hip and the knee. The CoTracker method showed huge differences compared to the manual labeling approach. However, the angle curves were correctly estimated by the MoveNet method, finding errors between 3.2° and 5.5°. In conclusion, our proposed VideoRun2D based on MoveNet core seems to be a helpful tool for evaluating sprint kinematics in some scenarios. On the other hand, the observed precision of this first version of VideoRun2D as a markerless sprint analysis system may not be yet enough for highly demanding applications. Future research lines towards that purpose are also discussed at the end: better tracking post-processing and user- and time-dependent adaptation.

动作捕捉运动分析无标记机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。