arXiv:2608.29287cs.CV2026-08中稿 · BMVC 2026

通过检测视频时序状态的持续变化,有效区分真实镜头切换与伪边界。

PERSIST: Persistent-State Discrimination for Shot Boundary Detection

论文配图:PERSIST: Persistent-State Discrimination for Shot Boundary Detection
图 1 · 摘自论文原文
  • 基于时序潜状态的持续性判断,替代传统局部变化检测。
  • 在诊断数据上减少33%-80%的伪边界误报,召回率保持不变。
  • 适用于真实视频、历史档案等复杂场景,适合需要高精度的视频分析任务。

镜头边界检测(SBD)通常被视作局部视觉不连续性的定位,但手持抖动、光照闪烁、运动模糊、遮挡及受损档案材料等常产生类似尖锐变化却无新镜头的情况。本文将SBD重构为边界语义判别:仅当局部变化伴随视频潜时序状态的持续更新时,才判定为边界,而非短暂偏离后恢复的趋势。该方法通过FiLM条件化的正弦表示网络构建连续潜状态,并结合局部变化、瞬时脉冲和回归趋势三类语义线索,在双速率时序主干中生成可解释的每帧信号。所提出的PERSIST框架使每个决策可追溯:持久性准则被训练进分类器,门控三元组保持可读性,学习到的潜状态具有明确的边界判别能力。在2,727段视频的分类型诊断测试中,相比同训基线,其将闪光、字幕叠加和档案类伪边界减少33%-80%;在匹配真边界召回率下,对TransNetV2的伪事件误报减半,且在ClipShots数据上降低约四分之一误报,同时保持召回率。在在线、广播、短视频和历史档案跨域评估中达到最强公开检测器水平,且训练条件更严——仅使用ClipShots真实过渡,而基准依赖额外数据集(其中85%过渡为合成)。

原文摘要 · Abstract (English)

Shot boundary detection (SBD) is widely treated as the localisation of local visual discontinuities, yet many false positives such as hand-held shake, illumination flicker, motion blur, occlusion, and damaged archival material produce equally sharp local change without introducing a new shot. We reformulate SBD as boundary semantic discrimination: a frame is favoured as a boundary only when its local change evidence is accompanied by a persistent update of the video's latent temporal state, rather than a transient excursion that returns to the surrounding trend. This persistence test is operationalised with a continuous latent state from a FiLM-conditioned sinusoidal representation network and a structured discriminator that combines three semantic cues, local change, transient impulse, and return-to-trend, into a single interpretable per-frame signal over a dual-rate temporal backbone. The resulting framework, PERSIST, turns every decision into an inspectable one: the persistence criterion is trained into the classifier, its per-frame effect stays readable from the gate triple, and its learned latent state is measurably boundary-discriminative. On a 2,727-video per-subtype diagnostic it removes 33-80% of flash, text-overlay, and archival false positives relative to an identically trained cue detector, and at matched true-transition recall it roughly halves TransNetV2's pseudo-event false positives on that diagnostic and cuts its false positives on ClipShots footage by about a quarter, while preserving recall. It does so while reaching parity with the strongest public detector across online, broadcast, short-form, and historical-archive transfer evaluations, under markedly stricter training: it learns from ClipShots real transitions only, whereas the anchor draws on additional corpora whose transitions are 85% synthetic. Code is available at https://github.com/linty5/PERSIST.

视频分析镜头检测深度学习边界判别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。