arXiv:2508.11212cs.CV2025-08

通过两阶段蒸馏与渐进图网络,实现轻量高精度人体姿态估计。

A Coarse-to-Fine Human Pose Estimation Method based on Two-stage Distillation and Progressive Graph Neural Network

  • 分两阶段蒸馏:先用关节结构损失传递语义知识,再用图像引导的渐进图卷积网络优化姿态
  • 在COCO和CrowdPose数据集上均优于现有方法,尤其在复杂人群场景提升显著
  • 适合需要低计算开销但高精度的姿态估计应用,如移动端实时识别

人体姿态估计广泛应用于以人为中心的理解与生成任务,但多数先进方法需大量计算资源以实现准确预测。为构建准确、鲁棒且轻量的人体姿态估计算法,一种可行方案是通过知识蒸馏将强大教师模型的知识迁移到参数更少的学生模型中。然而,传统蒸馏框架未能充分挖掘人体关节点间的上下文信息。为此,本文提出一种新颖的粗到精两阶段知识蒸馏框架。第一阶段引入人体关节点结构损失,挖掘关节点间的结构信息,实现从教师模型到学生模型的高层语义知识迁移。第二阶段采用图像引导的渐进图卷积网络(IGP-GCN),对第一阶段得到的初始姿态进行精细化修正,并通过教师模型最终输出姿态以渐进方式监督IGP-GCN训练。在标准数据集COCO关键点和CrowdPose上的大量实验表明,所提方法在性能上优于众多现有最先进方法,尤其在更复杂的CrowdPose数据集上表现更为突出,提升效果显著。

原文摘要 · Abstract (English)

Human pose estimation has been widely applied in the human-centric understanding and generation, but most existing state-of-the-art human pose estimation methods require heavy computational resources for accurate predictions. In order to obtain an accurate, robust yet lightweight human pose estimator, one feasible way is to transfer pose knowledge from a powerful teacher model to a less-parameterized student model by knowledge distillation. However, the traditional knowledge distillation framework does not fully explore the contextual information among human joints. Thus, in this paper, we propose a novel coarse-to-fine two-stage knowledge distillation framework for human pose estimation. In the first-stage distillation, we introduce the human joints structure loss to mine the structural information among human joints so as to transfer high-level semantic knowledge from the teacher model to the student model. In the second-stage distillation, we utilize an Image-Guided Progressive Graph Convolutional Network (IGP-GCN) to refine the initial human pose obtained from the first-stage distillation and supervise the training of the IGP-GCN in the progressive way by the final output pose of teacher model. The extensive experiments on the benchmark dataset: COCO keypoint and CrowdPose datasets, show that our proposed method performs favorably against lots of the existing state-of-the-art human pose estimation methods, especially for the more complex CrowdPose dataset, the performance improvement of our model is more significant.

姿态估计知识蒸馏图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。