用动态中心点统一人体姿态与分割,提升复杂场景下的精度与速度。
Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation
- 将关键点作为动态中心点,结合高置信度关键点生成实例嵌入。
- 在CrowdPose等数据集上达到92.1% AP,推理速度比主流方法快30%。
- 适合实时人体分割与姿态估计,尤其适用于重叠或快速运动场景。
人体的动态运动给姿态估计和体部分割带来了根本性挑战。现有方法主要依赖关键点热图与分割掩码的组合,但在关节重叠或姿态快速变化时表现不佳。为此,我们提出关键点作为动态中心点(KDC),一种统一的人体姿态估计与实例级分割的新范式。KDC采用自底向上的策略,生成可区分与复杂关键点的热图,并通过关键点圆盘机制提升关键点检测与置信度。利用高置信度关键点作为嵌入空间中的动态中心点生成掩码中心点,实现快速像素聚类,适应实时环境中身体的快速运动。在CrowdPose、OCHuman和COCO基准上的实验表明,KDC在准确率与运行效率方面均表现出色,具备良好的泛化能力。代码已公开:https://sites.google.com/view/niazahmad/projects/kdc。
原文摘要 · Abstract (English)
The dynamic movement of the human body presents a fundamental challenge for human pose estimation and body segmentation. State-of-the-art approaches primarily rely on combining keypoint heatmaps with segmentation masks but often struggle in scenarios involving overlapping joints or rapidly changing poses during instance-level segmentation. To address these limitations, we propose Keypoints as Dynamic Centroid (KDC), a new centroid-based representation for unified human pose estimation and instance-level segmentation. KDC adopts a bottom-up paradigm to generate keypoint heatmaps for both easily distinguishable and complex keypoints and improves keypoint detection and confidence scores by introducing KeyCentroids using a keypoint disk. It leverages high-confidence keypoints as dynamic centroids in the embedding space to generate MaskCentroids, allowing for swift clustering of pixels to specific human instances during rapid body movements in live environments. Our experimental evaluations on the CrowdPose, OCHuman, and COCO benchmarks demonstrate KDC's effectiveness and generalizability in challenging scenarios in terms of both accuracy and runtime performance. The implementation is available at: https://sites.google.com/view/niazahmad/projects/kdc.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。