arXiv:2607.10998cs.CV2026-07中稿 · ACM MM 2026

通过时间特征蒸馏提升体育视频事件精确定位,大幅减少标注依赖。

Temporal Feature Distillation for Label-Efficient Precise Event Spotting in Sports Videos

论文配图:Temporal Feature Distillation for Label-Efficient Precise Event Spotting in Sports Videos
图 1 · 摘自论文原文
  • 用时序特征对齐替代输出蒸馏,保留运动敏感边界信息。
  • 10%标注下在FSPerf上mAP提升4.54点,80%数据即达全监督效果。
  • 适合标注稀缺但需高精度定位的体育视频分析任务。

精确事件定位(PES)需区分视觉相似但语义不同的相邻帧,与图像分类和粗粒度动作识别有本质差异。尽管自蒸馏方法如DINO在图像中表现优异,但直接应用于PES无效:缺乏监督引导时,细微但关键的运动线索常被当作噪声抑制,导致模型对事件边界不敏感。为此,我们提出时间特征蒸馏,一种半监督目标,对齐具有时序信息的主干特征而非投影头输出,以保留运动敏感与边界感知的线索,实现帧级定位。通过带升温调度的监督预热稳定训练,确保在无标签蒸馏前已学习有意义事件线索。还引入Transformer Gate Shift模块,多尺度门控移位机制注入运动感知时序信息至视觉变换器。在四个细粒度体育基准测试上,性能持续优于全监督与半监督基线。在仅10%标注的FSPerf上,相较最强对比方法,mAP提升4.54点;使用80%标注数据时,在四个数据集中的两个上达到或超越全监督100%基线。

原文摘要 · Abstract (English)

Precise Event Spotting (PES) requires distinguishing visually similar yet semantically distinct adjacent frames, making it fundamentally different from image classification and coarse action recognition. Although self-distillation methods such as DINO have shown strong representation learning ability in images, we find that directly applying them to PES is ineffective: without supervised guidance, subtle but crucial motion cues are often suppressed as noise, leading to representations that are insensitive to precise event boundaries. To address this, we propose Temporal Feature Distillation, a semi-supervised objective that aligns temporally informative backbone features, rather than projection-head outputs, to preserve motion-sensitive and boundary-aware cues for frame-level localization. A supervised warm-up with a ramp-up schedule further stabilizes training by ensuring that meaningful event cues are learned before unlabeled distillation begins. We also introduce Transformer Gate Shift, a multi-scale gated shifting module that injects motion-aware temporal information into Vision Transformers. Experiments on four fine-grained sports benchmarks show consistent improvements over fully supervised and semi-supervised baselines. Under 10\% supervision on FSPerf, our method improves mAP by 4.54 points over the strongest competing approach, and with only 80\% labeled data, it matches or surpasses the fully supervised 100\% baseline on two of the four datasets.

事件定位半监督视频理解时间建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。