让AI生成有球员名、懂比赛数据的实时足球解说
Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoning

- 分两阶段:先视觉定位球员,再融合历史数据和实时状态
- 球员识别准确率提升18.5%,超越Gemini 2.5-pro
- 适合想做智能体育解说或人机交互的开发者
足球解说对提升观赛体验至关重要。以往自动解说方法多采用端到端生成匿名文本,缺乏真实直播解说中的实体指代、上下文准确性及比赛数据洞察。为此,我们提出GameSight,一种两阶段的知识增强视觉推理模型,将足球解说生成视为需精准指代球员与球队的知识型任务。首先通过视觉推理对齐匿名实体与细粒度视觉及上下文信息;随后结合外部历史统计数据与迭代更新的内部比赛状态进行内容优化。在SN-Caption-test-align数据集上,模型球员对齐准确率相比Gemini 2.5-pro提升18.5%。进一步知识增强后,模型在段级准确率、解说质量、全局上下文相关性与结构完整性方面均表现更优。本工作为实现更具信息量与沉浸感的人机互动体育应用奠定基础。
原文摘要 · Abstract (English)
Soccer commentary plays a crucial role in enhancing the soccer game viewing experience for audiences. Previous studies in automatic soccer commentary generation typically adopt an end-to-end method to generate anonymous live text commentary. Such generated commentary is insufficient in the context of real-world live televised commentary, as it contains anonymous entities, context-dependent errors and lacks statistical insights of the game events. To bridge the gap, we propose GameSight, a two-stage model to address soccer commentary generation as a knowledge-enhanced visual reasoning task, enabling live-televised-like knowledgeable commentary with accurate reference to entities (players and teams). GameSight starts by performing visual reasoning to align anonymous entities with fine-grained visual and contextual analysis. Subsequently, the entity-aligned commentary is refined with knowledge by incorporating external historical statistics and iteratively updated internal game state information. Consequently, GameSight improves the player alignment accuracy by 18.5% on SN-Caption-test-align dataset compared to Gemini 2.5-pro. Combined with further knowledge enhancement, GameSight outperforms in segment-level accuracy and commentary quality, as well as game-level contextual relevance and structural composition. We believe that our work paves the way for a more informative and engaging human-centric experience with the AI sports application. Demo Page: https://gamesight2025.github.io/gamesight2025
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。