提出分段架构,精准预测指尖和腕部,减少远端关节误差累积。
EHPE: A Segmented Architecture for Enhanced Hand Pose Estimation
- 分两阶段:先定位指尖与腕部,再用双分支网络精修其余关节。
- 在两个主流数据集上达到当前最优性能,显著降低远端关节误差。
- 适合需要高精度手势识别的虚拟现实与人机交互场景。
3D手部姿态估计在人机交互、虚拟现实等领域具有重要意义,准确估计手部关节点是高质量姿态重建的关键。然而,现有方法常忽略远端指节尖端(TIP)和腕部的重要性,且未能有效应对手势估计中远端关节的误差累积问题,导致部分关节点误差增大,引发姿态错位与重建质量下降。为此,本文提出增强型手部姿态估计分段架构(EHPE)。该方法通过局部提取TIP和腕部关节点,缓解误差累积对TIP预测的影响,并在此基础上进一步降低所有关节点的预测误差。EHPE包含两个关键阶段:第一阶段(TW-stage)专门估计TIP与腕部位置,提供初始精确关节点配置;第二阶段(PG-stage)采用双分支交互网络,对剩余关节点进行精细化估计。在两个广泛使用的基准数据集上的大量实验表明,EHPE实现当前最优性能。代码已开源:https://github.com/SereinNout/EHPE。
原文摘要 · Abstract (English)
3D hand pose estimation has garnered great attention in recent years due to its critical applications in human-computer interaction, virtual reality, and related fields. The accurate estimation of hand joints is essential for high-quality hand pose estimation. However, existing methods neglect the importance of Distal Phalanx Tip (TIP) and Wrist in predicting hand joints overall and often fail to account for the phenomenon of error accumulation for distal joints in gesture estimation, which can cause certain joints to incur larger errors, resulting in misalignments and artifacts in the pose estimation and degrading the overall reconstruction quality. To address this challenge, we propose a novel segmented architecture for enhanced hand pose estimation (EHPE). We perform local extraction of TIP and wrist, thus alleviating the effect of error accumulation on TIP prediction and further reduce the predictive errors for all joints on this basis. EHPE consists of two key stages: In the TIP and Wrist Joints Extraction stage (TW-stage), the positions of the TIP and wrist joints are estimated to provide an initial accurate joint configuration; In the Prior Guided Joints Estimation stage (PG-stage), a dual-branch interaction network is employed to refine the positions of the remaining joints. Extensive experiments on two widely used benchmarks demonstrate that EHPE achieves state-of-the-arts performance. Code is available at https://github.com/SereinNout/EHPE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。