用不确定性评估3D关键点到解剖标志的映射质量,实现自动质量控制。
Uncertainty-Aware Mapping from 3D Keypoints to Anatomical Landmarks for Markerless Biomechanics
- 基于时间建模框架,分离观测噪声与模型自身不确定性。
- 不确定性与误差强相关(斯皮尔曼ρ≈0.63),可筛选出16.8mm误差的可靠帧。
- 适用于标记式生物力学分析中异常帧检测,适合运动分析研究者使用。
无标记生物力学越来越多依赖视频提取的3D骨骼关键点,但下游映射通常将这些估计视为确定性结果,缺乏逐帧质量控制机制。本文研究预测不确定性作为将3D姿态关键点映射至3D解剖标志的置信度量化指标,这是逆运动学与肌肉骨骼分析前的关键步骤。在时间学习框架下,同时建模观测噪声带来的不确定性与模型局限性引起的不确定性。利用AMASS数据集上的同步动作捕捉真值,通过误差-不确定性秩相关、风险-覆盖率分析及灾难性异常值检测,在帧和关节层面评估不确定性。实验显示,尤其模型不确定性估计与地标误差存在强单调关联(斯皮尔曼ρ≈0.63),可实现可靠帧选择(10%覆盖率下误差降至≈16.8mm)并准确检测严重失败(误差>50mm时ROC-AUC≈0.92)。在加入高斯噪声与模拟缺失关节等受控退化条件下,可靠性排序仍稳定。相比之下,观测噪声引起的不确定性在此设置下贡献有限,表明关键点到标志映射的主要失效由模型不确定性主导。结果确立了预测不确定性作为无标记生物力学流程中实用的逐帧质量控制工具。
原文摘要 · Abstract (English)
Markerless biomechanics increasingly relies on 3D skeletal keypoints extracted from video, yet downstream biomechanical mappings typically treat these estimates as deterministic, providing no principled mechanism for frame-wise quality control. In this work, we investigate predictive uncertainty as a quantitative measure of confidence for mapping 3D pose keypoints to 3D anatomical landmarks, a critical step preceding inverse kinematics and musculoskeletal analysis. Within a temporal learning framework, we model both uncertainty arising from observation noise and uncertainty related to model limitations. Using synchronized motion capture ground truth on AMASS, we evaluate uncertainty at frame and joint level through error--uncertainty rank correlation, risk--coverage analysis, and catastrophic outlier detection. Across experiments, uncertainty estimates, particularly those associated with model uncertainty, exhibit a strong monotonic association with landmark error (Spearman $ρ\approx 0.63$), enabling selective retention of reliable frames (error reduced to $\approx 16.8$ mm at 10% coverage) and accurate detection of severe failures (ROC-AUC $\approx 0.92$ for errors $>50$ mm). Reliability ranking remains stable under controlled input degradation, including Gaussian noise and simulated missing joints. In contrast, uncertainty attributable to observation noise provides limited additional benefit in this setting, suggesting that dominant failures in keypoint-to-landmark mapping are driven primarily by model uncertainty. Our results establish predictive uncertainty as a practical, frame-wise tool for automatic quality control in markerless biomechanical pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。