首个支持足球比赛全程动作定位的多模态多智能体数据集,助力自动化生成比赛实况记录。
FOOTPASS: A Multi-Modal Multi-Agent Tactical Context Dataset for Play-by-Play Action Spotting in Soccer Broadcast Videos
- 融合视觉追踪与战术规律,实现球员级动作精准定位
- 覆盖整场比赛,支持长时序战术上下文分析
- 适合研究体育视频理解与智能分析的科研人员
足球视频理解催生了多种任务数据集,如时间动作定位、时空动作检测(STAD)或多目标跟踪(MOT)。构建结构化事件序列(谁在何时何地做什么)用于足球分析,需整合STAD与MOT的全视角方法。然而,现有动作识别技术仍不足以完全自动化标注,仅能辅助人工。同时,战术建模、轨迹预测与表现分析等研究已基于比赛状态和实况数据发展成熟。这促使我们利用战术知识作为先验,提升基于计算机视觉的预测能力,实现更自动、可靠的实况数据提取。本文提出FOOTPASS:首个在多模态、多智能体战术背景下,针对完整足球比赛进行实况动作定位的基准数据集。它支持以球员为中心的动作定位方法,结合计算机视觉输出(如追踪、身份识别)与足球战术规律(长期时序模式),生成可靠的比赛实况数据流。此类数据流是数据驱动体育分析的关键输入。
原文摘要 · Abstract (English)
Soccer video understanding has motivated the creation of datasets for tasks such as temporal action localization, spatiotemporal action detection (STAD), or multiobject tracking (MOT). The annotation of structured sequences of events (who does what, when, and where) used for soccer analytics requires a holistic approach that integrates both STAD and MOT. However, current action recognition methods remain insufficient for constructing reliable play-by-play data and are typically used to assist rather than fully automate annotation. Parallel research has advanced tactical modeling, trajectory forecasting, and performance analysis, all grounded in game-state and play-by-play data. This motivates leveraging tactical knowledge as a prior to support computer-vision-based predictions, enabling more automated and reliable extraction of play-by-play data. We introduce Footovision Play-by-Play Action Spotting in Soccer Dataset (FOOTPASS), the first benchmark for play-by-play action spotting over entire soccer matches in a multi-modal, multi-agent tactical context. It enables the development of methods for player-centric action spotting that exploit both outputs from computer-vision tasks (e.g., tracking, identification) and prior knowledge of soccer, including its tactical regularities over long time horizons, to generate reliable play-by-play data streams. These streams form an essential input for data-driven sports analytics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。