用关节角度优化人体姿态估计,提升轨迹平滑性与准确性
Joint angle based learning to refine kinematic human pose estimation
- 以关节角度描述姿态,构建更稳定的运动表征
- 用高阶傅里叶级数拟合关节角变化,生成高质量训练真值
- 双向循环网络后处理,显著改善复杂动作中姿态误差
无标记人体姿态估计在多个领域应用日益广泛。现有方法在关键点识别和关键点轨迹的随机波动方面仍存在不足,且深度学习模型的精炼性能受限于人工标注不准确的训练数据。本文提出一种新方法:(i) 基于关节角度的鲁棒运动姿态描述;(ii) 利用高阶傅里叶级数近似关节角的时间变化,生成可靠的“真实标签”;(iii) 设计双向循环网络作为后处理模块,对单帧姿态估计模型进行精炼。基于该方法构建的高质量数据集训练的网络,在纠正错误识别关键点和光滑时空轨迹方面表现优异。实验表明,关节角度精炼(JAR)在花样滑冰、Breaking等挑战性动作中优于当前最优的姿态精炼网络,同时具备修正现有数据集的潜力。
原文摘要 · Abstract (English)
Marker-free human pose estimation (HPE) has found increasing applications in various fields. Current HPE suffers from occasional errors in keypoint recognition and random fluctuation in keypoint trajectories when analyzing kinematic human poses. The performance of existing deep learning-based models for HPE refinement is considerably limited by inaccurate training datasets in which the keypoints are manually annotated. This paper proposed a novel method to overcome the difficulty, in which the key techniques include: (i) A robust joint angle-based description of kinematic human poses; (ii) Approximating temporal variation of joint angles using high order Fourier series to get reliable "ground truth"; (iii) A bidirectional recurrent network is designed as a post-processing module to refine the estimation of single image-based HPE models. Trained with the high-quality dataset constructed using our method, the network demonstrates outstanding performance to correct wrongly recognized joints and smooth their spatiotemporal trajectories. Tests show that joint angle-based refinement (JAR) outperforms the state-of-the-art HPE refinement network in challenging cases like figure skating and breaking. JAR also demonstrates great potential to rectify existing datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。