arXiv:2606.25619cs.CV2026-06被引 1

通过显式建模尺度关系,提升手部姿态估计的全局精度与局部细节。

ScaleHP: Scale-Mediated Optimization of Coupled Errors for Metric-Space Hand Pose Estimation

  • 将尺度作为连接相对几何与根节点定位的共享接口,统一优化耦合误差。
  • 在FreiHand上实现35.8mm的CS-MPJPE,多数据集达最佳PA-MPJPE表现。
  • 适合需要高精度三维手部姿态估计的AR/VR与机器人抓取任务。

本文提出ScaleHP,一个统一框架,通过显式表示每实例的度量尺度,解决校准相机空间中手部姿态估计的耦合误差问题。在常见的根节点相对全局范式下,相机空间精度依赖于相对几何、根节点定位及其尺度相关组合。ScaleHP将尺度视为这些项之间的共享接口,而非孤立优化。其度量感知的2D-3D Transformer解码器引入专用尺度令牌,与稀疏语义索引的2D/3D关节查询交互,使全局度量推理与局部关节几何相互修正。一个无参数的校准模块则基于预测的单位尺度关节、度量尺度和已知相机内参恢复根节点平移。ScaleHP在FreiHand上实现35.8mm的最优CS-MPJPE,且在基准特定训练协议下,在FreiHand、DexYCB和HO3Dv3上分别取得5.0/4.6/5.9mm的最优PA-MPJPE,表明全局度量定位与局部运动结构同时提升。消融实验进一步验证了尺度-姿态交互对相机空间精度和相对深度几何的改进作用。

原文摘要 · Abstract (English)

In this paper, we present ScaleHP, a unified framework that explicitly represents per-instance metric scale to resolve the coupled errors in calibrated camera-space hand pose estimation. Under the common root-relative-to-global paradigm, camera-space accuracy depends jointly on relative geometry, root localization, and their scale-dependent composition. ScaleHP treats scale as the shared interface among these terms rather than optimizing them in isolation. Its metric-aware 2D-3D Transformer decoder introduces a dedicated scale token that exchanges information with sparse, semantically indexed 2D/3D joint queries, allowing global metric reasoning and local joint geometry to mutually refine one another. A parameter-free calibrated module then recovers root translation from the predicted unit-scale joints, metric scale, and known camera intrinsics. ScaleHP demonstrates state-of-the-art CS-MPJPE on FreiHand (35.8 mm) and, under benchmark-specific training protocols, state-of-the-art PA-MPJPE on FreiHand, DexYCB, and HO3Dv3 (5.0/4.6/5.9 mm), showing that improved global metric localization is attained together with improved local articulation. Ablations further show that scale-pose interaction improves both camera-space accuracy and relative depth geometry.

手部姿态估计度量学习2D-3D对齐Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。