arXiv:2507.12292cs.CV2025-07

不用人体姿态估计,用深度图和局部图像块实现高效引体向上动作识别

Efficient Calisthenics Skills Classification through Foreground Instance Selection and Depth Estimation

  • 通过深度估计和运动员图像块检索,跳过耗时的姿态分析环节
  • 推理速度比传统方法快38.3倍,深度图分类准确率达0.837
  • 模块化设计便于替换组件,适合移动端实时应用

引体向上动作识别是通过图像推断运动员执行动作的计算机视觉任务,支持自动评估与个性化分析。传统方法依赖姿态估计获取骨骼数据,再输入分类器判断动作,但该过程计算开销大、延迟高,难以用于实时或移动场景。本文提出一种直接识别方法,结合深度估计与运动员图像块检索,避免使用昂贵的人体姿态估计模块。采用Depth Anything V2进行深度估计,YOLOv10定位运动员,从背景中分割出主体,不依赖传统姿态分析。该策略显著提升效率,降低推理时间,并提高分类准确率:使用RGB图像块实现38.3倍加速,深度图块分类准确率达0.837(优于骨架法的0.815)。此外,系统模块化设计支持组件灵活替换,便于未来优化及实际部署。

原文摘要 · Abstract (English)

Calisthenics skill classification is the computer vision task of inferring the skill performed by an athlete from images, enabling automatic performance assessment and personalized analytics. Traditional methods for calisthenics skill recognition are based on pose estimation methods to determine the position of skeletal data from images, which is later fed to a classification algorithm to infer the performed skill. Despite the progress in human pose estimation algorithms, they still involve high computational costs, long inference times, and complex setups, which limit the applicability of such approaches in real-time applications or mobile devices. This work proposes a direct approach to calisthenics skill recognition, which leverages depth estimation and athlete patch retrieval to avoid the computationally expensive human pose estimation module. Using Depth Anything V2 for depth estimation and YOLOv10 for athlete localization, we segment the subject from the background rather than relying on traditional pose estimation techniques. This strategy increases efficiency, reduces inference time, and improves classification accuracy. Our approach significantly outperforms skeleton-based methods, achieving 38.3x faster inference with RGB image patches and improved classification accuracy with depth patches (0.837 vs. 0.815). Beyond these performance gains, the modular design of our pipeline allows for flexible replacement of components, enabling future enhancements and adaptation to real-world applications.

动作识别深度估计高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。