arXiv:2607.08725cs.CVcs.AI2026-07

将3D人体姿态估计与生物力学属性预测连接,实现从骨骼点到运动分析的跨越

Pose-to-Biomechanics: Bridging 3D Human Pose Estimation and Biomechanical Attribute Prediction

论文配图:Pose-to-Biomechanics: Bridging 3D Human Pose Estimation and Biomechanical Attribute Prediction
图 1 · 摘自论文原文
  • 轻量级时序模块接入任意3D姿态估计算法,直接输出生物力学属性
  • 在Human3.6Mplus数据集上实现帧级对齐监督,提升预测准确性
  • 适用于康复、运动科学等需要物理可解释性分析的场景

近年来,3D人体姿态估计在无标记骨骼运动恢复方面取得显著进展,但多数算法仍以关键点几何精度为优化目标。而康复、运动科学、人因工程和临床运动分析等实际应用更关注身体运动、受力与激活的生物力学特征。本文提出BioModule,一个轻量级、可插拔的时序变压器模块,可部署于任意3D姿态估计算法下游,基于标准17关节3D骨架预测生物力学属性。该模块与上游姿态模型解耦,无需修改原模型,实现视觉姿态估计向物理可解释运动分析的扩展。为训练与评估,我们构建了大规模对齐数据集,将Human3.6M视频与3D关键点与Human3.6Mplus的生物力学标签空间进行帧级对齐,建立坐标系间解剖对应关系,支持跨模态精准监督。利用此对齐监督,BioModule成功预测多种生物力学量。我们在七种主流3D姿态估计算法上进行了基准测试,首次系统分析上游姿态精度如何影响下游生物力学预测质量。结果表明,BioModule作为紧凑、模块化的桥梁,有效连接视觉姿态估计与生物力学意义的人体运动分析。

原文摘要 · Abstract (English)

Recent progress in 3D human pose estimation has made markerless recovery of skeletal motion increasingly accurate and scalable. However, most pose estimators remain optimized for geometric keypoint accuracy, while many real-world applications in rehabilitation, sports science, ergonomics, and clinical movement analysis require biomechanical quantities that describe how the body moves, loads, and activates. In this work, we propose BioModule, a lightweight plug-in temporal transformer that attaches downstream of any 3D pose estimator and predicts biomechanical attributes from standard 17-joint 3D skeletons. BioModule is estimator-agnostic and requires no modification of the upstream pose model, enabling existing pose estimators to be extended toward physically interpretable motion analysis. To train and evaluate BioModule, we construct a large-scale aligned dataset pairing Human3.6M video and 3D keypoints with the biomechanical label space of Human3.6Mplus. We establish and verify anatomical correspondence between coordinate systems of the two datasets, enabling frame-accurate cross-modal supervision. Using this aligned supervision, BioModule predicts biomechanical quantities. We further benchmark BioModule across seven state-of-the-art 3D pose estimators, providing the first systematic analysis of how upstream pose estimation quality propagates to downstream biomechanical prediction fidelity. The results position BioModule as a compact, modular bridge between vision-based pose estimation and biomechanically meaningful human motion analysis.

生物力学姿态估计运动分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。