arXiv:2411.04501cs.CV2024-11被引 20

用人体姿态预测网球运动员未来轨迹,实现自动跟拍。

Pose2Trajectory: Using Transformers on Body Pose to Predict Tennis Player's Trajectory

  • 基于关节数据与球位置,用Transformer建模人体运动
  • 在不同预测长度下准确率优于基线方法
  • 适合体育视频自动化拍摄与动作分析场景

追踪网球运动员的运动轨迹可帮助摄像师实现自动跟拍。本研究提出Pose2Trajectory方法,通过人体关节数据和球的位置信息,预测运动员未来的运动轨迹序列。该方法采用编码器-解码器Transformer架构,在包含单打比赛视频的高质量数据集上训练,该数据集通过目标检测与人体姿态估计获得球员与球的边界框及关节坐标。实验表明,结合关节信息与球位置可显著提升轨迹预测精度,支持多种预测长度,为近距离摄像机自动跟踪提供依据。

原文摘要 · Abstract (English)

Tracking the trajectory of tennis players can help camera operators in production. Predicting future movement enables cameras to automatically track and predict a player's future trajectory without human intervention. Predicting future human movement in the context of complex physical tasks is also intellectually satisfying. Swift advancements in sports analytics and the wide availability of videos for tennis have inspired us to propose a novel method called Pose2Trajectory, which predicts a tennis player's future trajectory as a sequence derived from their body joints' data and ball position. Demonstrating impressive accuracy, our approach capitalizes on body joint information to provide a comprehensive understanding of the human body's geometry and motion, thereby enhancing the prediction of the player's trajectory. We use encoder-decoder Transformer architecture trained on the joints and trajectory information of the players with ball positions. The predicted sequence can provide information to help close-up cameras to keep tracking the tennis player, following centroid coordinates. We generate a high-quality dataset from multiple videos to assist tennis player movement prediction using object detection and human pose estimation methods. It contains bounding boxes and joint information for tennis players and ball positions in singles tennis games. Our method shows promising results in predicting the tennis player's movement trajectory with different sequence prediction lengths using the joints and trajectory information with the ball position.

姿态预测轨迹预测Transformer体育视频

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。