arXiv:2412.06258cs.CV2024-12被引 4

用虚拟标记提升3对3篮球多目标跟踪,减少误标和身份切换。

Enhanced Multi-Object Tracking Using Pose-based Virtual Markers in 3x3 Basketball

  • 基于姿态生成虚拟标记,自动标注球员位置与身份
  • 平均HOTA达72.3%,比无虚拟标记方法高10点以上,零身份切换
  • 大幅降低人工标注成本,适合体育分析与自动化追踪场景

多目标跟踪(MOT)在团队运动分析中至关重要,如评估战术、动作与表现。尽管行人跟踪已通过检测-跟踪框架取得进展,但篮球等团队运动面临玩家移动不可预测、频繁近距离互动及外观相似等挑战,导致姿态标注困难、遮挡严重、身份频繁切换以及人工标注成本高。为此,我们提出一种基于姿态的虚拟标记(VM)MOT方法——Sports-vmTracking,该方法源自用于多动物跟踪的vmTracking,并引入主动学习。首先,构建了3x3篮球姿态数据集并应用主动学习优化虚拟标记生成;随后,在视频上叠加虚拟标记以识别球员,提取带唯一ID的姿态,并转化为边界框与自动跟踪方法对比。基于3x3篮球数据集,验证了虚拟标记配置的有效性,显著减少了训练阶段的人工修正与标注需求,同时保持高精度。本方法平均HOTA得分为72.3%,超过不使用虚拟标记的先进方法10个百分点以上,且实现0次身份切换。该框架不仅有效缓解遮挡问题、减少身份混淆,还大幅提升了时间与成本效率,优于传统人工标注方式。

原文摘要 · Abstract (English)

Multi-object tracking (MOT) is crucial for various multi-agent analyses such as evaluating team sports tactics and player movements and performance. While pedestrian tracking has advanced with Tracking-by-Detection MOT, team sports like basketball pose unique challenges. These challenges include players' unpredictable movements, frequent close interactions, and visual similarities that complicate pose labeling and lead to significant occlusions, frequent ID switches, and high manual annotation costs. To address these challenges, we propose a novel pose-based virtual marker (VM) MOT method for team sports, named Sports-vmTracking. This method builds on the vmTracking approach developed for multi-animal tracking with active learning. First, we constructed a 3x3 basketball pose dataset for VMs and applied active learning to enhance model performance in generating VMs. Then, we overlaid the VMs on video to identify players, extract their poses with unique IDs, and convert these into bounding boxes for comparison with automated MOT methods. Using our 3x3 basketball dataset, we demonstrated that our VM configuration has been highly effective, and reduced the need for manual corrections and labeling during pose model training while maintaining high accuracy. Our approach achieved an average HOTA score of 72.3%, over 10 points higher than other state-of-the-art methods without VM, and resulted in 0 ID switches. Beyond improving performance in handling occlusions and minimizing ID switches, our framework could substantially increase the time and cost efficiency compared to traditional manual annotation.

多目标跟踪篮球分析虚拟标记姿态估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。