arXiv:2510.19622cs.CV2025-10ICCV被引 1

无需额外数据,通过两阶段训练提升视频片段定位精度

Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning

论文配图:Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning
图 1 · 摘自论文原文
  • 利用增强数据与课程学习构建边界和语义感知基础
  • 双查询机制实现模型在真实场景下的泛化能力提升
  • 适合需要高精度视频定位的下游任务应用

现有视频片段定位方法面临三大瓶颈:(1)数据稀缺导致模型仅建立浅层关键词-特征关联;(2)相邻事件间边界模糊;(3)细粒度语义区分能力不足(如区分‘踢球’与‘传球’)。本文提出零外部依赖的增强型定位框架AMR,通过两个关键洞察突破局部最优:(1)在不依赖额外标注的前提下,解决现有标注中的边界模糊与语义混淆问题;(2)在训练中保留并强化边界与语义判别能力,同时实现对真实场景的良好泛化。设计两阶段训练流程:第一阶段采用课程学习在增强数据上进行冷启动,建立基础边界与语义感知;第二阶段引入双查询机制——原始查询保持基于DETR的定位能力(使用冷启动模型的冻结基础查询),主动查询则动态适应真实数据分布。跨阶段蒸馏损失确保原始查询与基础查询的一致性,防止知识遗忘的同时支持真实世界泛化。在多个基准测试中,AMR均优于现有最先进方法。

原文摘要 · Abstract (English)

Existing Moment Retrieval methods face three critical bottlenecks: (1) data scarcity forces models into shallow keyword-feature associations; (2) boundary ambiguity in transition regions between adjacent events; (3) insufficient discrimination of fine-grained semantics (e.g., distinguishing ``kicking" vs. ``throwing" a ball). In this paper, we propose a zero-external-dependency Augmented Moment Retrieval framework, AMR, designed to overcome local optima caused by insufficient data annotations and the lack of robust boundary and semantic discrimination capabilities. AMR is built upon two key insights: (1) it resolves ambiguous boundary information and semantic confusion in existing annotations without additional data (avoiding costly manual labeling), and (2) it preserves boundary and semantic discriminative capabilities enhanced by training while generalizing to real-world scenarios, significantly improving performance. Furthermore, we propose a two-stage training framework with cold-start and distillation adaptation. The cold-start stage employs curriculum learning on augmented data to build foundational boundary/semantic awareness. The distillation stage introduces dual query sets: Original Queries maintain DETR-based localization using frozen Base Queries from the cold-start model, while Active Queries dynamically adapt to real-data distributions. A cross-stage distillation loss enforces consistency between Original and Base Queries, preventing knowledge forgetting while enabling real-world generalization. Experiments on multiple benchmarks show that AMR achieves improved performance over prior state-of-the-art approaches.

视频定位两阶段训练边界检测语义区分

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。