预测足球直播视频中未来5-10秒的球类动作,提升赛事分析智能化水平。
Action Anticipation from SoccerNet Football Video Broadcasts
- 基于FUTR改进的FAANTRA模型,专用于足球直播中球相关动作的前瞻预测。
- 在5秒和10秒预测窗口内,mAP@$δ$达到0.42,表明预测具备时间精度。
- 适合体育智能分析、自动转播与战术决策系统开发者参考使用。
人工智能已深刻改变体育视频分析方式,无论是理解长片段未剪辑视频中的比赛行为,还是预测未来帧中球员动作。然而,对尚未发生动作的提前预测研究仍较少。本文提出足球直播视频中的动作前瞻任务,目标是在未来5秒或10秒内预测未观测帧中的动作。为此,我们发布SoccerNet Ball Action Anticipation数据集,基于SoccerNet Ball Action Spotting构建。同时提出Football Action ANticipation TRAnsformer(FAANTRA)作为基线方法,通过适配FUTR这一先进动作前瞻模型实现球类动作预测。为评估性能,引入新指标:mAP@$δ$衡量预测动作的时间精度,mAP@∞评估其在预测窗口内的出现概率。通过大量消融实验分析不同任务设定、输入配置与模型结构的影响。实验结果表明该任务具备可行性,但也揭示挑战,为体育分析预测模型设计提供重要启示。通过提前预测动作,本工作可推动自动化转播、战术分析与球员决策应用。数据集与代码已公开于https://github.com/MohamadDalal/FAANTRA。
原文摘要 · Abstract (English)
Artificial intelligence has revolutionized the way we analyze sports videos, whether to understand the actions of games in long untrimmed videos or to anticipate the player's motion in future frames. Despite these efforts, little attention has been given to anticipating game actions before they occur. In this work, we introduce the task of action anticipation for football broadcast videos, which consists in predicting future actions in unobserved future frames, within a five- or ten-second anticipation window. To benchmark this task, we release a new dataset, namely the SoccerNet Ball Action Anticipation dataset, based on SoccerNet Ball Action Spotting. Additionally, we propose a Football Action ANticipation TRAnsformer (FAANTRA), a baseline method that adapts FUTR, a state-of-the-art action anticipation model, to predict ball-related actions. To evaluate action anticipation, we introduce new metrics, including mAP@$δ$, which evaluates the temporal precision of predicted future actions, as well as mAP@$\infty$, which evaluates their occurrence within the anticipation window. We also conduct extensive ablation studies to examine the impact of various task settings, input configurations, and model architectures. Experimental results highlight both the feasibility and challenges of action anticipation in football videos, providing valuable insights into the design of predictive models for sports analytics. By forecasting actions before they unfold, our work will enable applications in automated broadcasting, tactical analysis, and player decision-making. Our dataset and code are publicly available at https://github.com/MohamadDalal/FAANTRA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。