arXiv:2501.11069cs.CV2025-01

用递归结构精修人体姿态估计特征,提升精度且参数更少

Refinement Module based on Parse Graph for Human Pose Estimation

  • 通过自适应递归分解与组合,融合局部细节与全局语义
  • 在多架构上提升姿态估计性能,参数量更少
  • 可插件式嵌入主流模型,适合追求轻量化高精度的场景

解析图被广泛用于人体姿态估计中建模人体的层次结构与上下文关系,但现有方法常存在参数冗余问题,且依赖预定义网络结构,限制了其在其他方法中的应用。为此,本文提出一种基于解析图的精修模块RMPG(Refinement Module based on Parse Graph),通过递归的自顶向下分解与自底向上组合子节点特征图并融合上下文信息,实现特征图的自适应精修。通过递归层次化融合,RMPG将局部细节与全局语义整合为更具结构性的特征表示,同时携带上下文信息,从而提升关节推断精度。RMPG可灵活作为插件嵌入多种主流姿态估计网络中,并通过监督子节点特征图,以较少参数学习不同身体部位间的上下文关系与层次结构。大量实验表明,RMPG在不同架构下均有效提升性能,同时以更低参数建模人体层次与上下文关系。代码已开源:https://github.com/lushbng/RMPG。

原文摘要 · Abstract (English)

Parse graphs have been widely used in Human Pose Estimation (HPE) to model the hierarchical structure and context relations of the human body. However, such methods often suffer from parameter redundancy. More importantly, they rely on predefined network structures, which limits their use in other methods. To address these issues, we propose a new context relation and hierarchical structure modeling module, RMPG (Refinement Module based on Parse Graph). RMPG adaptively refines feature maps through recursive top-down decomposition of feature maps and bottom-up composition of sub-node feature maps with context information. Through recursive hierarchical composition, RMPG fuses local details and global semantics into more structured feature representations, accompanied by context information, thereby improving the accuracy of joint inference. RMPG can be flexibly embedded as a plug-in into various mainstream HPE networks. Moreover, by supervising sub-node features map, RMPG learns the context relations and hierarchical structure between different body parts with fewer parameters. Extensive experiments show that RMPG improves performance across different architectures while effectively modeling hierarchical and context relations of the human body with fewer parameters. The RMPG code can be found at https://github.com/lushbng/RMPG.

人体姿态估计结构建模轻量化设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。