构建首个专家级网球分析数据集与实时理解框架
TennisExpert: Towards Expert-Level Analytical Sports Video Understanding
- 融合视频解析与记忆增强模型,实现多模态网球理解
- 在471.9小时比赛中表现优于GPT-5等商用模型
- 适合体育分析、智能教练与实时解说系统研究者
网球是全球最受关注的运动之一,产生大量广播录像,具备专业分析、自动训练和实时解说的巨大潜力。然而,由于缺乏大规模细粒度标注数据集和专家级解说,自动网球理解仍处于探索阶段。为此,我们提出TennisVL,一个包含超过200场职业比赛(471.9小时)和4万余个回合级片段的大规模网球基准数据集。与侧重描述性解说的现有数据集不同,TennisVL强调专家级战术分析,涵盖策略推理、选手决策与比赛节奏变化。同时,我们设计TennisExpert框架,基于Qwen3-VL-8B构建,结合视频语义解析器与分层记忆模块,提取得分、击球序列、球落地点及球员位置,并捕捉短/长期时序上下文。实验表明,TennisExpert持续优于GPT-5、Gemini、Claude等强基线模型,在战术理解与比赛动态把握上表现更优。数据集与代码已开源。
原文摘要 · Abstract (English)
Tennis is one of the most widely followed sports, generating extensive broadcast footage with strong potential for professional analysis, automated coaching, and real-time commentary. However, automatic tennis understanding remains underexplored due to two key challenges: (1) the lack of large-scale benchmarks with fine-grained annotations and expert-level commentary, and (2) the difficulty of building accurate yet efficient multimodal systems suitable for real-time deployment. To address these challenges, we introduce TennisVL, a large-scale tennis benchmark comprising over 200 professional matches (471.9 hours) and 40,000+ rally-level clips. Unlike existing commentary datasets that focus on descriptive play-by-play narration, TennisVL emphasizes expert analytical commentary capturing tactical reasoning, player decisions, and match momentum. Furthermore, we propose TennisExpert, a multimodal tennis understanding framework that integrates a video semantic parser with a memory-augmented model built on Qwen3-VL-8B. The parser extracts key match elements (e.g., scores, shot sequences, ball bounces, and player locations), while hierarchical memory modules capture both short- and long-term temporal context. Experiments show that TennisExpert consistently outperforms strong proprietary baselines, including GPT-5, Gemini, and Claude, and demonstrates improved ability to capture tactical context and match dynamics. Our dataset and code are publicly available at https://github.com/LZYAndy/TennisExpert.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。