解决人体运动重建中形态与姿态混淆问题,提升动作与体型还原精度。
SmoCap: Movement Reconstruction under Morphology-Pose Ambiguity through Unified Scale-Pose Canonicalization

- 统一尺度-姿态建模,通过约束优化消除形态姿态歧义。
- 在28次试验中,膝关节朝向误差降低1.68度,体型重建误差减少0.73~1.9毫米。
- 适合需可解释动作与体型的生物力学分析、康复评估等场景。
运动重建流程需要同时支持可解释的关节运动与受试者体型估计,而不仅是低标记拟合误差。相同的标记拟合误差可能由不同形态与姿态组合解释,且弱观测自由度无法唯一确定,导致解在数值上可接受但解剖上不一致。本文提出SmoCap,一种统一尺度-姿态框架,在弱观测条件下仍能保持协调运动并消除形态-姿态歧义。SmoCap通过带约束的信赖域二次规划求解,采用解析映射的姿势与尺度雅可比矩阵。在匹配观测下,与经典OpenSim基线对比,使用荧光透视获取的膝关节运动和体测真值作为外部参考。极端瑜伽序列进一步测试弱观测下的脊柱协调运动。控制实验中,OpenSim的标记均方根误差更低(8.81对19.14毫米),而SmoCap在28次试验中的24次及所有6名受试者中,膝关节朝向均方根误差更低(5.82对7.50度)。平均绝对体测端点误差:在CAMS-Knee上为8.44对9.51毫米,在Riglet上为6.87对8.77毫米。代理耦合在瑜伽消融中保持了表达性与协调的脊柱运动,仅增加0.14毫米拟合误差(+0.6%)。每帧中位运行时间0.204-0.332毫秒,始终2-3次迭代。仅依赖标记均方根误差无法可靠指示运动或体型恢复质量。SmoCap结合统一尺度-姿态估计与代理协调机制,在外部评估中实现更低的运动与体型误差,支持弱观测感知的群体规模运动重建,适用于依赖可解释动作与体型的下游流程。
原文摘要 · Abstract (English)
Movement reconstruction pipelines need estimates that support interpretable joint motion and subject morphology, not only low marker fitting error. The same marker fitting error can be explained by different mixtures of morphology and posture, while weakly observed degrees of freedom are not uniquely identifiable, yielding anatomically inconsistent yet numerically acceptable solutions. We present SmoCap, a unified scale-pose framework that resolves morphology-posture ambiguity while preserving coordinated motion under weak observability. SmoCap solves a constrained trust-region QP with analytical proxy-mapped pose and scale Jacobians. Under matched observations, SmoCap is compared with an established OpenSim baseline using fluoroscopy-derived knee motion and anthropometric ground truth as external references. Extreme yoga sequences further probe coordinated spine motion under weak observability. In the controlled comparison, the OpenSim baseline achieved lower marker RMSE (8.81 vs 19.14 mm), whereas SmoCap achieved lower knee-orientation RMSE against fluoroscopy (5.82 deg vs 7.50 deg) in 24 of 28 trials and all six subjects. Mean absolute anthropometric endpoint errors were 8.44 vs 9.51 mm on CAMS-Knee and 6.87 vs 8.77 mm on Riglet for SmoCap and OpenSim, respectively. Proxy coupling preserved expressive and coordinated spine motion with marginal fitting error increase (+0.14 mm, +0.6%) in the yoga ablation. Median runtime was 0.204-0.332 ms/frame, with consistently 2-3 iterations. Marker RMSE alone did not reliably indicate better motion or morphology recovery. SmoCap instead combines unified scale-pose estimation with proxy coordination. It achieved lower motion and morphology errors in the external evaluations while supporting weak-observability-aware, cohort-scale movement reconstruction for downstream pipelines that depend on interpretable subject motion and morphology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。