arXiv:2410.01304cs.CV2024-10被引 8

构建首个足球视频动作定位数据集,推动自动识别比赛关键动作

Deep learning for action spotting in association football videos

  • 基于SoccerNet构建550+场完整赛事标注数据集
  • 涵盖足球比赛中几乎所有动作类型,支持深度学习模型训练
  • 通过年度挑战赛吸引全球研究者,促进行业应用落地

动作定位任务旨在从长篇未剪辑的视频流中同时识别动作并精确时间定位。自动提取这些动作对体育分析、教练辅助和球迷互动等应用至关重要。然而,2018年前缺乏公开的大规模体育动作定位数据集,制约了该任务的发展。为此,我们团队在SoccerNet框架下构建了目前最大且最全面的体育视频理解数据集,其中包含专门用于动作定位的子集——SoccerNet Action Spotting,涵盖超过550场完整广播比赛,标注了几乎全部足球比赛中可能出现的动作类型。该数据集为开发自动识别感兴趣动作的方法(包括深度学习方法)提供了大量人工标注数据。为促进学术交流,SoccerNet每年举办挑战赛,吸引全球参与者。过去五年中,已有60余种方法被提出或发表,持续改进初始基线,使动作定位成为体育产业可行的技术方案。本文回顾了自2018年该任务诞生以来的发展历程及其在科研与产业中的作用。

原文摘要 · Abstract (English)

The task of action spotting consists in both identifying actions and precisely localizing them in time with a single timestamp in long, untrimmed video streams. Automatically extracting those actions is crucial for many sports applications, including sports analytics to produce extended statistics on game actions, coaching to provide support to video analysts, or fan engagement to automatically overlay content in the broadcast when specific actions occur. However, before 2018, no large-scale datasets for action spotting in sports were publicly available, which impeded benchmarking action spotting methods. In response, our team built the largest dataset and the most comprehensive benchmarks for sports video understanding, under the umbrella of SoccerNet. Particularly, our dataset contains a subset specifically dedicated to action spotting, called SoccerNet Action Spotting, containing more than 550 complete broadcast games annotated with almost all types of actions that can occur in a football game. This dataset is tailored to develop methods for automatic spotting of actions of interest, including deep learning approaches, by providing a large amount of manually annotated actions. To engage with the scientific community, the SoccerNet initiative organizes yearly challenges, during which participants from all around the world compete to achieve state-of-the-art performances. Thanks to our dataset and challenges, more than 60 methods were developed or published over the past five years, improving on the first baselines and making action spotting a viable option for the sports industry. This paper traces the history of action spotting in sports, from the creation of the task back in 2018, to the role it plays today in research and the sports industry.

动作定位足球视频SoccerNet深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。