arXiv:2607.24098cs.CV2026-07

无需训练,通过反馈机制提升视频目标分割准确率

ReflexTrack: A Feedback-Driven Agent for Training-Free Referring Video Object Segmentation

论文配图:ReflexTrack: A Feedback-Driven Agent for Training-Free Referring Video Object Segmentation
图 1 · 摘自论文原文
  • 引入闭环反馈机制,迭代优化初始框和正负点
  • 在Ref-VPS上达到69.7的$/mathcal{Q}$得分,ReasonVOS上达67.2的$/mathcal{J}&/mathcal{F}$
  • 适合追求高精度、无训练成本的视频分割应用

指代视频目标分割(RVOS)需在视频中分割自然语言描述的目标。近期基于智能体的方法结合多模态大模型与可提示分割模型,实现无需任务特定训练的RVOS。然而,多数流程依赖单次空间定位后进行掩码传播,未验证初始提示与时间预测。我们提出ReflexTrack,一种无需训练的反馈驱动智能体,在空间与时间层面闭环验证。掩码引导的空间精炼评估当前关键帧提示生成的掩码,迭代更新边界框及正负点,获得更可靠初始化。视频级掩码反思评估完整掩码序列,定位不可靠区间,选择互补修复关键帧,并通过掩码引导重传播生成候选预测。仅当候选预测带来验证改进时才更新对应区间,保护其他可靠预测。所有组件推理时保持冻结。ReflexTrack在Ref-VPS上取得69.7的$/mathcal{Q}$分数,在ReasonVOS上取得67.2的$/mathcal{J}&/mathcal{F}$分数。结果表明,预测级反馈显著提升无训练RVOS的可靠性。

原文摘要 · Abstract (English)

Referring video object segmentation (RVOS) requires segmenting a target specified by natural language throughout a video. Recent agentic approaches combine multimodal large language models with promptable segmentation models to perform RVOS without task-specific training. However, most pipelines rely on one-shot spatial grounding followed by mask propagation, leaving both the initial prompts and temporal predictions largely unverified. We introduce ReflexTrack, a training-free, feedback-driven agent that closes this loop at both spatial and temporal levels. Mask-guided Spatial Refinement evaluates the mask induced by the current keyframe prompt and iteratively updates the bounding box together with positive and negative points, yielding a more reliable initialization. Video-level Mask Reflection assesses the complete mask sequence, localizes unreliable intervals, selects complementary repair keyframes, and generates candidate predictions through mask-guided re-propagation. Only candidates that provide a verified improvement are used to update the affected intervals, preserving reliable predictions elsewhere. All components remain frozen during inference. ReflexTrack achieves an overall $\mathcal{Q}$ score of $69.7$ on Ref-VPS and a $\mathcal{J}\&\mathcal{F}$ score of $67.2$ on ReasonVOS. These results demonstrate that prediction-level feedback substantially improves the reliability of training-free RVOS.

视频分割智能体反馈机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。