arXiv:2605.13604cs.CV2026-05

用自注意力取代固定图卷积,提升2D到3D手部姿态估计精度

Rethinking Graph Convolution for 2D-to-3D Hand Pose Lifting

论文配图:Rethinking Graph Convolution for 2D-to-3D Hand Pose Lifting
图 1 · 摘自论文原文
  • 用可学习的自注意力替代固定图卷积,实现动态空间聚合
  • 在FPHA数据集上将MPJPE从12.36mm降至10.09mm
  • 图距离位置编码作为软结构先验更有效,适合手部建模

图卷积网络(GCNs)广泛用于3D手部姿态估计,通常将手部骨架编码为固定邻接图。本文在FPHA基准上进行受控、参数匹配的消融实验,表明多头自注意力始终优于标准GCN基线。即使在增强GCN的多跳邻接并匹配参数量后,自注意力仍使MPJPE从12.36 mm降低至10.09 mm。引入骨架约束的图注意力网络恢复了大部分性能差距,说明输入依赖的聚合是主要提升来源;而全连接注意力带来额外增益。进一步发现,将手部拓扑作为图距离位置编码的软结构先验,比硬性邻接约束更有效。结果表明,对于手部姿态提升任务,自适应空间注意力比固定图卷积更具优势。

原文摘要 · Abstract (English)

Graph convolutional networks (GCNs) are widely used for 3D hand pose estimation, where the hand skeleton is encoded as a fixed adjacency graph. We revisit whether this is the most effective way to incorporate hand topology in 2D-to-3D lifting. In this paper, we perform controlled, parameter-matched ablations on the FPHA benchmark and show that standard multi-head self-attention consistently outperforms GCN baselines. Even when the GCN is strengthened with multi-hop adjacency and matched parameter count, self-attention reduces MPJPE from 12.36 mm to 10.09 mm. A skeleton-constrained graph attention network recovers most of this gap, indicating that input-dependent aggregation is a major source of improvement, while fully connected attention yields additional gains. We further show that hand topology is most effective when introduced as a soft structural prior through graph-distance positional encoding, rather than as a hard adjacency constraint. These results suggest that, for hand pose lifting, adaptive spatial attention is a more effective inductive bias than fixed graph convolution.

3D姿态估计自注意力图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。