arXiv:2508.11538cs.CV2025-08被引 16

用强化学习让视频分割模型先思考再分割,提升准确率与可信度。

Reinforcing Video Reasoning Segmentation to Think Before It Segments

  • 基于思维链和强化学习优化推理过程,增强时空理解能力。
  • 在ReVOS和ReasonVOS上分别提升1.3和10.0的J&F指标。
  • 适合需要高精度视频理解与可解释性的研究者使用。

视频推理分割(VRS)旨在根据隐含指令(包含人类意图与时间逻辑)精准分割视频中的目标对象。现有方法依赖大视觉语言模型(LVLM)将物体语义编码为<SEG>标记进行掩码预测,但存在推理过程不透明、时空推理不足的问题。受强化学习启发,本文提出专用的LVLM Veason-R1,强调分割前的结构化推理。首先构建高质量思维链训练数据,训练出监督微调模型Veason-SFT,实现视频语义与帧级空间定位的对齐;随后通过组相对策略优化(GRPO)微调,结合思维链初始化,鼓励推理空间高效探索。设计综合奖励机制,协同提升空间对齐与时间一致性,强化关键帧定位与细粒度定位能力。大量实验证明,Veason-R1在多个基准上达到当前最优表现,相比先前方法显著提升(如ReVOS上+1.3 J&F,ReasonVOS上+10.0 J&F),且对幻觉更具鲁棒性(+8.8 R)。代码与模型权重将公开于Veason-R1。

原文摘要 · Abstract (English)

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to encode object semantics into <SEG> tokens for mask prediction. However, this paradigm suffers from limited interpretability during inference and suboptimal performance due to inadequate spatiotemporal reasoning. Drawing inspiration from seminal breakthroughs in reinforcement learning, we introduce Veason-R1, a specialized LVLM for VRS that emphasizes structured reasoning in segmentation. Veason-R1 is trained through Group Relative Policy Optimization (GRPO) augmented with Chain-of-Thought (CoT) initialization. To begin with, we curate high-quality CoT training data to instill structured reasoning trajectories, bridging video-level semantics and frame-level spatial grounding, yielding the supervised fine-tuned model Veason-SFT. Subsequently, GRPO fine-tuning encourages efficient exploration of the reasoning space by optimizing reasoning chains. To this end, we incorporate a holistic reward mechanism that synergistically enhances spatial alignment and temporal consistency, bolstering keyframe localization and fine-grained grounding. Comprehensive empirical evaluations demonstrate that Veason-R1 achieves state-of-the-art performance on multiple benchmarks, surpassing prior art by significant margins (e.g., +1.3 J &F in ReVOS and +10.0 J &F in ReasonVOS), while exhibiting robustness to hallucinations (+8.8 R). Our code and model weights will be available at Veason-R1.

视频分割推理增强强化学习思维链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。