arXiv:2410.20427cs.CV2024-10被引 4

构建首个跳躍空中時間精細分析數據集,助力花滑技術評估

YourSkatingCoach: A Figure Skating Video Benchmark for Fine-Grained Element Analysis

  • 提出空中時間檢測新任務,將跳躍時長識別轉為序列標註問題
  • 構建含454段視頻的數據集,標註每跳起落幀與空中時間
  • 基於Transformer模型實現精準計時,可遷移至其他運動分析

將機器學習與體育結合需依賴體育數據,但現有花滑數據集多僅關注動作分類,且難獲取或覆蓋有限,大幅提高技術門檻。現有數據粗粒度,僅能辨識動作類型,難判斷品質優劣。本文提出空中時間檢測這一新運動分析任務,目標是精確識別跳躍的空中時長。我們構建了YourSkatingCoach數據集,包含454段跳躍視頻,每段均含骨架檢測結果及每跳起止幀的金標註,形成花滑視頻分析基準。與傳統分類不同,本文將該任務視為序列標註,設計基於Transformer的模型計算跳躍持續時間。實驗表明,所提模型在強基線下表現優異。進一步驗證標註細粒度的泛化能力,將相同流程應用於其他運動的粗粒度動作分類任務,微調後展示花滑動作結構對跨運動遷移的強適應性。

原文摘要 · Abstract (English)

Combining sports and machine learning involves leveraging ML algorithms and techniques to extract insight from sports-related data such as player statistics, game footage, and other relevant information. However, datasets related to figure skating in the literature focus primarily on element classification and are currently unavailable or exhibit only limited access, which greatly raise the entry barrier to developing visual sports technology for it. Moreover, when using such data to help athletes improve their skills, we find they are very coarse-grained: they work for learning what an element is, but they are poorly suited to learning whether the element is good or bad. Here we propose air time detection, a novel motion analysis task, the goal of which is to accurately detect the duration of the air time of a jump. We present YourSkatingCoach, a large, novel figure skating dataset which contains 454 videos of jump elements, the detected skater skeletons in each video, along with the gold labels of the start and ending frames of each jump, together as a video benchmark for figure skating. In addition, although this type of task is often viewed as classification, we cast it as a sequential labeling problem and propose a Transformer-based model to calculate the duration. Experimental results show that the proposed model yields a favorable results for a strong baseline. To further verify the generalizability of the fine-grained labels, we apply the same process to other sports as cross-sports tasks but for coarse-grained task action classification. Here we fine-tune the classification to demonstrate that figure skating, as it contains the essential body movements, constitutes a strong foundation for adaptation to other sports.

花滑分析動作識別序列標註跨運動遷移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。