arXiv:2602.01095cs.CV2026-02中稿 · NeurIPS被引 1

通过将2D姿态先验传播到3D锚点空间,提升单图3D人体姿态估计精度。

PandaPose: 3D Human Pose Lifting from a Single Image via Propagating 2D Pose Prior to 3D Anchor Space

  • 用3D锚点空间作为中间表示,融合姿态与深度信息
  • 在Human3.6M上误差降低14.7%,优于当前最佳方法
  • 特别适合处理遮挡和2D姿态不准确的情况

从单张RGB图像进行3D人体姿态估计是3D视觉中的挑战性任务。现有方法通常基于2D特征建立关节到关节的直接映射,存在两大缺陷:输入2D姿态预测误差会传播至3D结果,且难以处理自遮挡情况。本文提出PandaPose,通过将2D姿态先验传播至3D锚点空间实现3D人体姿态恢复。该3D锚点空间包含三部分:(1) 以标准坐标系定义的关节级3D锚点,提供精确鲁棒的先验以缓解2D姿态误差;(2) 深度感知的分层特征提升,整合深度信息解决自遮挡模糊性;(3) 锚点-特征交互解码器,将3D锚点与提升特征结合生成统一锚点查询,封装关节级3D锚点集、视觉线索和几何深度信息。这些锚点查询用于支持锚点到关节的集成预测。在Human3.6M、MPI-INF-3DHP和3DPW三个基准上的实验表明,本方法显著优于现有技术,在困难条件下(Human3.6M)误差降低14.7%,定性对比也验证了其有效性与鲁棒性。

原文摘要 · Abstract (English)

3D human pose lifting from a single RGB image is a challenging task in 3D vision. Existing methods typically establish a direct joint-to-joint mapping from 2D to 3D poses based on 2D features. This formulation suffers from two fundamental limitations: inevitable error propagation from input predicted 2D pose to 3D predictions and inherent difficulties in handling self-occlusion cases. In this paper, we propose PandaPose, a 3D human pose lifting approach via propagating 2D pose prior to 3D anchor space as the unified intermediate representation. Specifically, our 3D anchor space comprises: (1) Joint-wise 3D anchors in the canonical coordinate system, providing accurate and robust priors to mitigate 2D pose estimation inaccuracies. (2) Depth-aware joint-wise feature lifting that hierarchically integrates depth information to resolve self-occlusion ambiguities. (3) The anchor-feature interaction decoder that incorporates 3D anchors with lifted features to generate unified anchor queries encapsulating joint-wise 3D anchor set, visual cues and geometric depth information. The anchor queries are further employed to facilitate anchor-to-joint ensemble prediction. Experiments on three well-established benchmarks (i.e., Human3.6M, MPI-INF-3DHP and 3DPW) demonstrate the superiority of our proposition. The substantial reduction in error by $14.7\%$ compared to SOTA methods on the challenging conditions of Human3.6M and qualitative comparisons further showcase the effectiveness and robustness of our approach.

3D姿态估计单图重建锚点空间姿态提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。