用视频内生信息自动生成高质量训练数据,提升多模态大模型视频理解能力。
VideoSSR: Video Self-Supervised Reinforcement Learning
- 设计三种自监督预训练任务,利用视频内在信息生成标注
- 构建VIUBench基准,发现现有模型在新任务上表现显著不足
- 提出VideoSSR框架,在17个任务上平均提升超5%,适合视频理解研究者
基于可验证奖励的强化学习(RLVR)显著提升了多模态大语言模型(MLLMs)的视频理解能力。然而,MLLMs的快速发展已超越现有视频数据集的复杂度,而人工标注高质量新数据成本过高。本文探讨一个关键问题:能否利用视频中丰富的内在信息自动生成高质量、可验证的训练数据?为此,我们设计了三种自监督预训练任务:异常定位、物体计数和时间拼图。我们构建了视频内在理解基准(VIUBench)以验证其难度,结果显示当前最先进MLLMs在这些任务上表现明显不佳。基于这些预训练任务,我们构建了VideoSSR-30K数据集,并提出VideoSSR——一种新颖的视频自监督强化学习框架用于RLVR。在涵盖四个主要视频领域的17个基准上的大量实验表明,VideoSSR持续提升模型性能,平均提升超过5%。这些结果确立了VideoSSR作为推动更先进视频理解能力的基础框架。代码已开源:https://github.com/lcqysl/VideoSSR。
原文摘要 · Abstract (English)
Reinforcement Learning with Verifiable Rewards (RLVR) has substantially advanced the video understanding capabilities of Multimodal Large Language Models (MLLMs). However, the rapid progress of MLLMs is outpacing the complexity of existing video datasets, while the manual annotation of new, high-quality data remains prohibitively expensive. This work investigates a pivotal question: Can the rich, intrinsic information within videos be harnessed to self-generate high-quality, verifiable training data? To investigate this, we introduce three self-supervised pretext tasks: Anomaly Grounding, Object Counting, and Temporal Jigsaw. We construct the Video Intrinsic Understanding Benchmark (VIUBench) to validate their difficulty, revealing that current state-of-the-art MLLMs struggle significantly on these tasks. Building upon these pretext tasks, we develop the VideoSSR-30K dataset and propose VideoSSR, a novel video self-supervised reinforcement learning framework for RLVR. Extensive experiments across 17 benchmarks, spanning four major video domains (General Video QA, Long Video QA, Temporal Grounding, and Complex Reasoning), demonstrate that VideoSSR consistently enhances model performance, yielding an average improvement of over 5\%. These results establish VideoSSR as a potent foundational framework for developing more advanced video understanding in MLLMs. The code is available at https://github.com/lcqysl/VideoSSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。