arXiv:2510.06855cs.CVeess.IV2025-10ICCV被引 7

提出在线事件边界检测框架,实现视频流中实时事件分割。

Online Generic Event Boundary Detection

  • 基于人类感知理论,用预测误差判断事件变化
  • 在Kinetics-GEBD和TAPOS上达到接近离线方法的性能
  • 适合需要实时处理的视频分析场景

通用事件边界检测(GEBD)旨在通过人类感知视角解析长视频。然而,现有方法需完整视频帧才能预测,与人类实时处理方式不符。为此,我们提出新任务——在线通用事件边界检测(On-GEBD),目标是在视频流中即时检测事件边界。该任务面临识别细微、无分类标签事件变化的挑战,且无法获取未来帧信息。为此,我们提出受事件分割理论(EST)启发的Estimator框架,包含一致事件预测器(CEA)和在线边界判别器(OBD)。CEA仅基于历史帧预测未来帧以反映当前事件动态;OBD则通过统计测试分析预测误差,自适应调整阈值以捕捉多样细微的事件过渡。实验表明,Estimator优于所有基于近期在线视频理解模型的基线,并在Kinetics-GEBD和TAPOS数据集上表现接近先前离线GEBD方法。

原文摘要 · Abstract (English)

Generic Event Boundary Detection (GEBD) aims to interpret long-form videos through the lens of human perception. However, current GEBD methods require processing complete video frames to make predictions, unlike humans processing data online and in real-time. To bridge this gap, we introduce a new task, Online Generic Event Boundary Detection (On-GEBD), aiming to detect boundaries of generic events immediately in streaming videos. This task faces unique challenges of identifying subtle, taxonomy-free event changes in real-time, without the access to future frames. To tackle these challenges, we propose a novel On-GEBD framework, Estimator, inspired by Event Segmentation Theory (EST) which explains how humans segment ongoing activity into events by leveraging the discrepancies between predicted and actual information. Our framework consists of two key components: the Consistent Event Anticipator (CEA), and the Online Boundary Discriminator (OBD). Specifically, the CEA generates a prediction of the future frame reflecting current event dynamics based solely on prior frames. Then, the OBD measures the prediction error and adaptively adjusts the threshold using statistical tests on past errors to capture diverse, subtle event transitions. Experimental results demonstrate that Estimator outperforms all baselines adapted from recent online video understanding models and achieves performance comparable to prior offline-GEBD methods on the Kinetics-GEBD and TAPOS datasets.

视频理解事件检测在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。