arXiv:2501.14439cs.CV2025-01AAAI被引 5

聚焦人体与关节区域,提升动作估计精度。

Optimizing Human Pose Estimation Through Focused Human and Joint Regions

  • 分层掩码模块逐步聚焦目标人体和关键点。
  • 在PoseTrack2017上腕关节mAP达84.8,超越当前最优81.5。
  • 适合需要高精度人体姿态的视频分析场景。

人体姿态估计已广泛应用于动作识别、体育分析和监控等领域,但准确的视频姿态估计仍是开放挑战。现有方法通常从所有像素中学习运动线索,易受背景变化或他人动作干扰。尽管基于Transformer的方法具备全局建模能力,但在局部上下文感知和精确位置识别上表现不足。本文从三方面改进:(1) 提出双层人体-关键点掩码模块,实现从粗到细的视觉标记精炼,逐步聚焦目标人体和关键点,同时屏蔽无关区域;(2) 引入可变形交叉注意力机制与双向分离策略,自适应聚合受限邻域内的时空运动线索;(3) 数学形式化可变形交叉注意力,确保模型仅关注目标人体中心区域。实验表明,本方法在三个大规模基准数据集上达到最先进性能。显著成果是在具有挑战性的腕关节上取得84.8 mAP,显著优于当前最优方法的81.5 mAP(PoseTrack2017)。

原文摘要 · Abstract (English)

Human pose estimation has given rise to a broad spectrum of novel and compelling applications, including action recognition, sports analysis, as well as surveillance. However, accurate video pose estimation remains an open challenge. One aspect that has been overlooked so far is that existing methods learn motion clues from all pixels rather than focusing on the target human body, making them easily misled and disrupted by unimportant information such as background changes or movements of other people. Additionally, while the current Transformer-based pose estimation methods has demonstrated impressive performance with global modeling, they struggle with local context perception and precise positional identification. In this paper, we try to tackle these challenges from three aspects: (1) We propose a bilayer Human-Keypoint Mask module that performs coarse-to-fine visual token refinement, which gradually zooms in on the target human body and keypoints while masking out unimportant figure regions. (2) We further introduce a novel deformable cross attention mechanism and a bidirectional separation strategy to adaptively aggregate spatial and temporal motion clues from constrained surrounding contexts. (3) We mathematically formulate the deformable cross attention, constraining that the model focuses solely on the regions centered at the target person body. Empirically, our method achieves state-of-the-art performance on three large-scale benchmark datasets. A remarkable highlight is that our method achieves an 84.8 mean Average Precision (mAP) on the challenging wrist joint, which significantly outperforms the 81.5 mAP achieved by the current state-of-the-art method on the PoseTrack2017 dataset.

姿态估计Transformer视频理解可变形注意

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。