arXiv:2510.19475cs.CV2025-10

通过跨序列复用运动模式,提升单目3D人体姿态估计精度

PRGCN: A Graph Memory Network for Cross-Sequence Pattern Reuse in 3D Human Pose Estimation

  • 构建图记忆库存储人体动作原型,动态检索并融合先验知识
  • 在Human3.6M和MPI-INF-3DHP上分别达37.1mm和13.4mm的MPJPE
  • 适合关注动作规律复用与跨序列学习的研究者

单目3D人体姿态估计因2D到3D映射的深度歧义,仍属根本性难题。现有视频方法虽利用时间上下文增强空间推理,但普遍孤立处理每段序列,忽略跨序列中广泛存在的结构规律与重复动作模式。本文提出模式复用图卷积网络(PRGCN),将姿态估计转化为模式检索与适配问题。核心是图记忆库,以关系图形式学习并存储紧凑的姿态原型,通过注意力机制动态检索,并与硬编码解剖约束自适应融合,经由记忆驱动的图卷积确保几何合理性。为支撑鲁棒的时空特征提取,设计双流混合架构,结合Mamba状态空间模型的线性复杂度局部时序建模与自注意力的全局关系捕捉能力。在Human3.6M和MPI-INF-3DHP基准上,PRGCN实现37.1mm和13.4mm的MPJPE,刷新性能纪录,且具备更强跨域泛化能力。本工作表明,长期被忽视的跨序列模式复用机制对推动该领域至关重要,推动范式从逐序列优化转向累积知识学习。

原文摘要 · Abstract (English)

Monocular 3D human pose estimation remains a fundamentally ill-posed inverse problem due to the inherent depth ambiguity in 2D-to-3D lifting. While contemporary video-based methods leverage temporal context to enhance spatial reasoning, they operate under a critical paradigm limitation: processing each sequence in isolation, thereby failing to exploit the strong structural regularities and repetitive motion patterns that pervade human movement across sequences. This work introduces the Pattern Reuse Graph Convolutional Network (PRGCN), a novel framework that formalizes pose estimation as a problem of pattern retrieval and adaptation. At its core, PRGCN features a graph memory bank that learns and stores a compact set of pose prototypes, encoded as relational graphs, which are dynamically retrieved via an attention mechanism to provide structured priors. These priors are adaptively fused with hard-coded anatomical constraints through a memory-driven graph convolution, ensuring geometrical plausibility. To underpin this retrieval process with robust spatiotemporal features, we design a dual-stream hybrid architecture that synergistically combines the linear-complexity, local temporal modeling of Mamba-based state-space models with the global relational capacity of self-attention. Extensive evaluations on Human3.6M and MPI-INF-3DHP benchmarks demonstrate that PRGCN establishes a new state-of-the-art, achieving an MPJPE of 37.1mm and 13.4mm, respectively, while exhibiting enhanced cross-domain generalization capability. Our work posits that the long-overlooked mechanism of cross-sequence pattern reuse is pivotal to advancing the field, shifting the paradigm from per-sequence optimization towards cumulative knowledge learning.

3D姿态估计图神经网络动作复用时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。