arXiv:2512.14698cs.CVcs.AI2025-12被引 37

用高质量数据和新训练方法,让大模型视频定位能力大幅提升。

TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs

  • 构建高精度标注数据集,改进现有视频定位评测标准
  • 通过自动重标注获得10万条高质量训练数据,提升模型性能
  • 提出无需思考的强化学习训练法,效果超越部分闭源模型

本文不提出新方法,而是为视频时间定位(VTG)建立一个简单但关键的基准。尽管多模态大语言模型在视频理解任务中表现优异,但其在VTG上的优化策略仍不明确。本文提出TimeLens,从数据质量和算法设计两个维度系统研究如何提升模型的VTG能力。首先揭示现有基准中的严重标注质量问题,推出经过严格质量控制的TimeLens-Bench,对三个主流基准进行重新标注;分析显示模型排名发生显著变化,证明旧评估标准不可靠。同时,通过自动化重标注流程处理噪声训练数据,构建出包含10万条样本的高质量训练数据集TimeLens-100K。基于此数据基础,深入探索算法设计原则,提出时间编码与文本交错表示、无需思考的可验证奖励强化学习(RLVR)训练范式及配套训练方案。最终产出的TimeLens系列模型,在开源模型中达到最先进水平,甚至超越GPT-5和Gemini-2.5-Flash等闭源模型。所有代码、数据与模型将公开,以推动后续研究。

原文摘要 · Abstract (English)

This paper does not introduce a novel method but instead establishes a straightforward, incremental, yet essential baseline for video temporal grounding (VTG), a core capability in video understanding. While multimodal large language models (MLLMs) excel at various video understanding tasks, the recipes for optimizing them for VTG remain under-explored. In this paper, we present TimeLens, a systematic investigation into building MLLMs with strong VTG ability, along two primary dimensions: data quality and algorithmic design. We first expose critical quality issues in existing VTG benchmarks and introduce TimeLens-Bench, comprising meticulously re-annotated versions of three popular benchmarks with strict quality criteria. Our analysis reveals dramatic model re-rankings compared to legacy benchmarks, confirming the unreliability of prior evaluation standards. We also address noisy training data through an automated re-annotation pipeline, yielding TimeLens-100K, a large-scale, high-quality training dataset. Building on our data foundation, we conduct in-depth explorations of algorithmic design principles, yielding a series of meaningful insights and effective yet efficient practices. These include interleaved textual encoding for time representation, a thinking-free reinforcement learning with verifiable rewards (RLVR) approach as the training paradigm, and carefully designed recipes for RLVR training. These efforts culminate in TimeLens models, a family of MLLMs with state-of-the-art VTG performance among open-source models and even surpass proprietary models such as GPT-5 and Gemini-2.5-Flash. All codes, data, and models will be released to facilitate future research.

视频定位多模态大模型数据质量强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。