arXiv:2608.19723cs.CVcs.CL2026-08

用事件记忆实现实时足球解说,能回顾过去、总结近期、描述当下。

StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary

论文配图:StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary
图 1 · 摘自论文原文
  • 以事件为单位构建可更新的记忆库,动态管理历史信息。
  • 在三种解说场景下均表现优异,历史回忆得分达17.39(CIDEr)。
  • 适合需要实时处理长时视频流的场景,如直播解说系统。

实时视频理解要求模型在视频流到来时持续更新状态,并将不断增长的历史组织成可演化、可持久存储且可检索的语义单元,同时受限于计算与内存。这一挑战在直播足球解说中尤为突出:系统必须仅基于当前可用信息,描述已完成事件、总结近期比赛、回忆早期事件或保持沉默。本文提出StreamSoccer,一种基于事件驱动记忆的系统,将事件记忆作为中间表示。固定预算的主动记忆模块整合流数据;已完成事件的状态在本地保留并合并为可检索的历史记录。统一生成器结合当前、近期和历史上下文,输出三种解说模式,规则辅助调度器决定模式或静默。不同于基于帧、视觉标记或缓存的视频-语言模型,也区别于依赖预定义片段或输出时间戳的解说方法,StreamSoccer显式建模事件生命周期。我们构建了三轨实时足球解说数据集与分层评估协议。在常见参考锚点处,系统在当前事件、近期窗口和历史记忆解说任务上分别取得CIDEr 38.62、23.96、17.39,位列当前事件与历史记忆赛道第一,近期窗口第二。受控消融实验表明,本地保存已完成事件可提升所有任务表现,完整系统在三类任务上均最优。在58场赛事共174次原始视频运行中,每分钟推理延迟(RTF p95)维持在0.10至0.22之间,无随比赛进程增长趋势。结果表明,事件记忆可在多时间尺度支持实时解说,同时控制长历史计算开销。

原文摘要 · Abstract (English)

Streaming video understanding requires models to causally update state as video arrives and organize growing history into semantic units that can evolve, persist, and be recalled under bounded computation and memory. This challenge is pronounced in live soccer commentary, where a system must describe completed events, summarize recent play, recall earlier events, or remain silent using only information available before each utterance. We present StreamSoccer, an event-driven system that uses event memory as its intermediate representation. A fixed-budget active memory integrates the stream; completed event states are retained locally and consolidated into retrievable historical records. A unified generator uses current, recent, and historical context to produce three commentary modes, while a rule-assisted scheduler selects a mode or silence. Unlike streaming video-language models organized around frames, visual tokens, or caches, and soccer-commentary methods based on predefined clips or output timestamps, StreamSoccer explicitly models event lifecycles. We construct a three-track streaming soccer commentary dataset and a layered evaluation protocol. At common reference anchors, StreamSoccer obtains CIDEr scores of 38.62, 23.96, and 17.39 for current-event, recent-window, and historical-memory commentary, ranking first on the current-event and historical-memory tracks and second on recent-window. Controlled ablations show that local completed events improve all tracks and that the full system performs best on all three. Across 174 raw-video runs on 58 matches, per-minute RTF p95 ranges from 0.10 to 0.22 without sustained growth with match history. These results indicate that event memory supports streaming soccer commentary across temporal scopes while controlling long-history computation.

实时解说事件记忆足球分析视频理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。