arXiv:2410.22079cs.CV2024-10被引 16

用金字塔结构提升小人姿态估计精度,避免冗余计算。

HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation

  • 引入高分辨率金字塔模块,融合卷积先验增强细节感知
  • 替换热图法为SimCC,减少上采样开销,提升小尺度定位精度
  • 支持不同规模模型,从多个角度优化中小型人体姿态检测

中等和小尺度人体姿态估计长期面临挑战。现有方法多通过堆叠多个高成本的反卷积层或持续聚合低分辨率特征以保持高分辨率表示,易导致信息冗余。此外,热图方法受量化误差影响,在精确定位中、小尺度人体关键点时存在不足。本文提出HRPVT,采用PVT v2作为主干网络建模长距离依赖,并设计高分辨率金字塔模块(HRPM),将卷积神经网络的固有归纳偏置融入高分辨率特征图,生成更高质量的高分辨率表征。该模块增强了纯变压器模型在中、小尺度人体姿态估计上的表现。同时,我们用SimCC方法替代热图法,避免了昂贵的上采样层,使更多计算资源可用于HRPM。针对不同参数规模的模型,我们设计了两种HRPM插入策略,分别从两个角度提升模型对中、小尺度人体姿态的感知能力。

原文摘要 · Abstract (English)

Human pose estimation on medium and small scales has long been a significant challenge in this field. Most existing methods focus on restoring high-resolution feature maps by stacking multiple costly deconvolutional layers or by continuously aggregating semantic information from low-resolution feature maps while maintaining high-resolution ones, which can lead to information redundancy. Additionally, due to quantization errors, heatmap-based methods have certain disadvantages in accurately locating keypoints of medium and small-scale human figures. In this paper, we propose HRPVT, which utilizes PVT v2 as the backbone to model long-range dependencies. Building on this, we introduce the High-Resolution Pyramid Module (HRPM), designed to generate higher quality high-resolution representations by incorporating the intrinsic inductive biases of Convolutional Neural Networks (CNNs) into the high-resolution feature maps. The integration of HRPM enhances the performance of pure transformer-based models for human pose estimation at medium and small scales. Furthermore, we replace the heatmap-based method with SimCC approach, which eliminates the need for costly upsampling layers, thereby allowing us to allocate more computational resources to HRPM. To accommodate models with varying parameter scales, we have developed two insertion strategies of HRPM, each designed to enhancing the model's ability to perceive medium and small-scale human poses from two distinct perspectives.

姿态估计视觉变换器高分辨率小目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。