arXiv:2506.21980cs.CV2025-06被引 10

用强化学习让大模型直接做目标跟踪,支持框或文字初始化。

R1-Track: Direct Application of MLLMs to Visual Object Tracking via Reinforcement Learning

  • 用强化学习微调大模型,绕过传统分类回归设计。
  • 在GOT-10k上表现优于基线,小数据集即可训练。
  • 可灵活用框或文本初始化,保留大模型通用能力。

视觉单目标跟踪旨在给定首帧目标初始状态后,持续定位并估计后续视频帧中目标的位置与尺度。该任务传统上被视为模板匹配问题,历经相关滤波、双流网络、单流网络等阶段,取得显著进展。然而,这些方法通常需要显式的分类与回归建模,依赖大规模数据的监督训练,且仅限于跟踪单一任务,灵活性不足。近年来,多模态大语言模型(MLLMs)发展迅速。开源模型如Qwen2.5-VL具备强大的基础能力,在视觉定位任务中表现优异。这激发了将其直接应用于视觉跟踪的兴趣。然而实验发现,Qwen2.5-VL在图像对之间的模板匹配(即跟踪任务)上表现不佳。受DeepSeek-R1启发,我们采用组相对策略优化(GRPO)强化学习方法,在小规模数据集上使用基于规则的奖励函数对Qwen2.5-VL进行微调。得到的模型R1-Track在GOT-10k基准上取得了显著性能。R1-Track支持通过边界框或文本描述进行灵活初始化,同时保留了原模型的大部分通用能力。我们还进一步讨论了R1-Track的潜在改进方向。本技术报告总结截至2025年5月的研究成果。

原文摘要 · Abstract (English)

Visual single object tracking aims to continuously localize and estimate the scale of a target in subsequent video frames, given only its initial state in the first frame. This task has traditionally been framed as a template matching problem, evolving through major phases including correlation filters, two-stream networks, and one-stream networks with significant progress achieved. However, these methods typically require explicit classification and regression modeling, depend on supervised training with large-scale datasets, and are limited to the single task of tracking, lacking flexibility. In recent years, multi-modal large language models (MLLMs) have advanced rapidly. Open-source models like Qwen2.5-VL, a flagship MLLMs with strong foundational capabilities, demonstrate excellent performance in grounding tasks. This has spurred interest in applying such models directly to visual tracking. However, experiments reveal that Qwen2.5-VL struggles with template matching between image pairs (i.e., tracking tasks). Inspired by deepseek-R1, we fine-tuned Qwen2.5-VL using the group relative policy optimization (GRPO) reinforcement learning method on a small-scale dataset with a rule-based reward function. The resulting model, R1-Track, achieved notable performance on the GOT-10k benchmark. R1-Track supports flexible initialization via bounding boxes or text descriptions while retaining most of the original model's general capabilities. And we further discuss potential improvements for R1-Track. This rough technical report summarizes our findings as of May 2025.

视觉跟踪大模型强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。