用极坐标与神经距离场提升运动姿态估计精度,尤其适合模糊和遮挡场景。
Polar Coordinate-Based 2D Pose Prior with Neural Distance Field
- 基于极坐标建模关节连接长度,改进姿态估计的几何一致性
- 在跳远数据集上显著提升多种姿态表示的准确性
- 仅需少量标注数据,适合真实体育场景的泛化应用
人体姿态捕捉对体育分析至关重要,可精准评估运动员动作。尽管基于深度学习的RGB视频姿态估计模型在公开数据集上表现优异,但在真实体育场景中常受运动模糊、遮挡及不同姿态表示间域偏移影响。微调虽能缓解部分问题,但通常需大规模标注数据,且跨场景泛化能力有限。为此,我们提出一种基于神经距离场(NDF)的2D姿态先验引导优化方法。不同于仅依赖角度表示的方法,我们引入极坐标表示,显式包含关节连接长度,从而更准确修正错误姿态。此外,设计了一种非测地线距离度量,分离角度与径向差异,证明其比传统测地距离更适用于极坐标表示。为应对数据稀缺,提出基于梯度的批量投影增强策略,通过迭代优化生成逼真姿态样本。在跳远数据集上的实验表明,该方法可提升多种姿态表示下的估计性能,具备跨域鲁棒性。结果验证了其在仅需少量训练数据下显著提高姿态合理性。代码已开源:https://github.com/QGAN2019/polar-NDF。
原文摘要 · Abstract (English)
Human pose capture is essential for sports analysis, enabling precise evaluation of athletes' movements. While deep learning-based human pose estimation (HPE) models from RGB videos have achieved impressive performance on public datasets, their effectiveness in real-world sports scenarios is often hindered by motion blur, occlusions, and domain shifts across different pose representations. Fine-tuning these models can partially alleviate such challenges but typically requires large-scale annotated data and still struggles to generalize across diverse sports environments. To address these limitations, we propose a 2D pose prior-guided refinement approach based on Neural Distance Fields (NDF). Unlike existing approaches that rely solely on angular representations of human poses, we introduce a polar coordinate-based representation that explicitly incorporates joint connection lengths, enabling a more accurate correction of erroneous pose estimations. Additionally, we define a novel non-geodesic distance metric that separates angular and radial discrepancies, which we demonstrate is better suited for polar representations than traditional geodesic distances. To mitigate data scarcity, we develop a gradient-based batch-projection augmentation strategy, which synthesizes realistic pose samples through iterative refinement. Our method is evaluated on a long jump dataset, demonstrating its ability to improve 2D pose estimation across multiple pose representations, making it robust across different domains. Experimental results show that our approach enhances pose plausibility while requiring only limited training data. Code is available at: https://github.com/QGAN2019/polar-NDF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。