用排序损失提升人体姿态估计精度,让模型更懂评估指标。
RSPose: Ranking Based Losses for Human Pose Estimation
- 设计基于排序的损失函数,聚焦关键点峰值定位。
- 在COCO等数据集上提升1.5~2.3个点的mAP,ViTPose-H达79.9。
- 首次让损失与mAP评估指标对齐,适合追求高精度的开发者。
热图类人体姿态估计算法虽性能优异,但仍面临三大问题:(P1) 常用均方误差(MSE)损失对所有像素偏差同等惩罚,未能聚焦于锐化并准确定位关节对应峰值;(P2) 热图存在空间和类别不平衡;(P3) 评价指标(mAP)与损失函数不一致。本文提出基于排序的损失以解决上述问题。理论与实证表明,所提损失优于常用热图损失(MSE、KL散度)。该方法显著提升了置信度得分与定位质量的相关性,有利于非极大值抑制(NMS)中的实例筛选,从而获得更优的平均精度(mAP)。采用此损失训练的模型称为RSPose。其在二维和一维热图模式下,在COCO、CrowdPose、MPII三个数据集上均表现优异。据我们所知,RSPose是首个使损失与评估指标(mAP)对齐的方法。在COCO-val集上,ViTPose-H模型达到79.9 mAP,超越此前最优结果;同时,对SimCC ResNet-50的改进达1.5 AP,达到73.6 AP。
原文摘要 · Abstract (English)
While heatmap-based human pose estimation methods have shown strong performance, they suffer from three main problems: (P1) "Commonly used Mean Squared Error (MSE)" Loss may not always improve joint localization because it penalizes all pixel deviations equally, without focusing explicitly on sharpening and correctly localizing the peak corresponding to the joint; (P2) heatmaps are spatially and class-wise imbalanced; and, (P3) there is a discrepancy between the evaluation metric (i.e., mAP) and the loss functions. We propose ranking-based losses to address these issues. Both theoretically and empirically, we show that our proposed losses are superior to commonly used heatmap losses (MSE, KL-Divergence). Our losses considerably increase the correlation between confidence scores and localization qualities, which is desirable because higher correlation leads to more accurate instance selection during Non-Maximum Suppression (NMS) and better Average Precision (mAP) performance. We refer to the models trained with our losses as RSPose. We show the effectiveness of RSPose across two different modes: one-dimensional and two-dimensional heatmaps, on three different datasets (COCO, CrowdPose, MPII). To the best of our knowledge, we are the first to propose losses that align with the evaluation metric (mAP) for human pose estimation. RSPose outperforms the previous state of the art on the COCO-val set and achieves an mAP score of 79.9 with ViTPose-H, a vision transformer model for human pose estimation. We also improve SimCC Resnet-50, a coordinate classification-based pose estimation method, by 1.5 AP on the COCO-val set, achieving 73.6 AP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。