arXiv:2508.04299cs.CV2025-08被引 3

让不同长度的视频描述用专用查询定位,提升精准度。

Length Matters: Length-Aware Transformer for Temporal Sentence Grounding

  • 按描述时长分三组查询,分别处理短、中、长段落
  • 引入长度分类任务,抑制错配查询的预测
  • 在三个公开数据集上达到最新最好效果

时间句定位(TSG)旨在从无剪辑视频中定位与自然语言描述对应的时间片段。基于DETR的模型虽取得显著进展,但缺乏显式监督常导致学习到的查询角色重叠,产生冗余预测。为此,本文提出长度感知变压器(LATR),利用视频-描述对的时长先验,使每个查询承担特定角色。具体地,将所有查询分为三组,分别对应短、中、长时长片段的预测。训练时引入额外的长度分类任务,抑制长度不匹配查询的输出,引导其专注特定功能。大量实验表明,所提LATR在三个公开基准上均达当前最优性能。消融实验证明了各组件的有效性,凸显引入时长先验对TSG任务的关键作用。

原文摘要 · Abstract (English)

Temporal sentence grounding (TSG) is a highly challenging task aiming to localize the temporal segment within an untrimmed video corresponding to a given natural language description. Benefiting from the design of learnable queries, the DETR-based models have achieved substantial advancements in the TSG task. However, the absence of explicit supervision often causes the learned queries to overlap in roles, leading to redundant predictions. Therefore, we propose to improve TSG by making each query fulfill its designated role, leveraging the length priors of the video-description pairs. In this paper, we introduce the Length-Aware Transformer (LATR) for TSG, which assigns different queries to handle predictions based on varying temporal lengths. Specifically, we divide all queries into three groups, responsible for segments with short, middle, and long temporal durations, respectively. During training, an additional length classification task is introduced. Predictions from queries with mismatched lengths are suppressed, guiding each query to specialize in its designated function. Extensive experiments demonstrate the effectiveness of our LATR, achieving state-of-the-art performance on three public benchmarks. Furthermore, the ablation studies validate the contribution of each component of our method and the critical role of incorporating length priors into the TSG task.

时间定位Transformer视频理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。