arXiv:2603.08681cs.CV2026-03被引 1

改用关键点驱动范式,提升实时多人姿态估计精度与效率。

ER-Pose: Rethinking Keypoint-Driven Representation Learning for Real-Time Human Pose Estimation

  • 摒弃框预测,以关键点为核心目标设计新结构
  • 在COCO和CrowdPose上分别提升3.2/6.7(无预训练)
  • 无需NMS,参数更少,适合实时部署

单阶段多人群姿态估计旨在统一框架内完成人体定位与关键点预测,具备推理高效、结构简洁的优势。因此,类似YOLO的多尺度实时检测架构被广泛用于实时姿态估计。然而,这些方法通常继承目标检测中的框驱动建模范式,使姿态估计在训练中受边界框监督隐式约束,导致样本分配与特征表示偏差,引发任务错配,最终限制精度。本文从关键点驱动视角重新审视框驱动的单阶段姿态估计,发现并行目标间的语义冲突是性能下降的关键原因。为此,提出关键点驱动学习范式,将姿态估计设为首要预测目标:移除边界框预测,重构预测头以更好适应姿态的高维结构化表示;引入关键点驱动的动态样本分配策略,使训练目标与姿态评估指标对齐,实现密集监督与无NMS高效推理;进一步提出基于平滑OKS的损失函数,稳定回归型姿态估计的优化过程。基于上述设计,构建单阶段多人群姿态估计框架ER-Pose。在MS COCO和CrowdPose数据集上,ER-Pose-n相较基线YOLO-Pose,无预训练时提升AP 3.2/6.7,有预训练时提升7.4/4.9,且参数更少、推理更快。

原文摘要 · Abstract (English)

Single-stage multi-person pose estimation aims to jointly perform human localization and keypoint prediction within a unified framework, offering advantages in inference efficiency and architectural simplicity. Consequently, multi-scale real-time detection architectures, such as YOLO-like models, are widely adopted for real-time pose estimation. However, these approaches typically inherit a box-driven modeling paradigm from object detection, in which pose estimation is implicitly constrained by bounding-box supervision during training. This formulation introduces biases in sample assignment and feature representation, resulting in task misalignment and ultimately limiting pose estimation accuracy. In this work, we revisit box-driven single-stage pose estimation from a keypoint-driven perspective and identify semantic conflicts among parallel objectives as a key source of performance degradation. To address this issue, we propose a keypoint-driven learning paradigm that elevates pose estimation to a primary prediction objective. Specifically, we remove bounding-box prediction and redesign the prediction head to better accommodate the high-dimensional structured representations for pose estimation. We further introduce a keypoint-driven dynamic sample assignment strategy to align training objectives with pose evaluation metrics, enabling dense supervision during training and efficient NMS-free inference. In addition, we propose a smooth OKS-based loss function to stabilize optimization in regression-based pose estimation. Based on these designs, we develop a single-stage multi-person pose estimation framework, termed ER-Pose. On MS COCO and CrowdPose, ER-Pose-n achieves AP improvements of 3.2/6.7 without pre-training and 7.4/4.9 with pre-training respectively compared with the baseline YOLO-Pose. These improvements are achieved with fewer parameters and higher inference efficiency.

姿态估计实时系统关键点驱动模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。