arXiv:2603.18856cs.CVcs.AI2026-03被引 1

让视频模型显式表达物体运动轨迹,提升动态推理的可解释性与可信度。

Motion-o: Trajectory-Grounded Video Reasoning

  • 引入运动思维链(MCoT),用标签显式记录物体运动的方向、速度和尺度变化。
  • 在多个基准上实现更忠实于轨迹的推理表现,无需修改模型结构。
  • 适合关注视频动态理解、可解释推理的研究者与应用开发者。

当前视频推理模型常生成定位特定时间点物体的时空证据链,虽能说明‘何处’与‘何时’出现证据,却常隐去观察之间的运动过程,即‘如何’变化。这使得动态或依赖轨迹的判断难以监督、验证或惩罚。本文提出空间-时间-轨迹(STT)推理新范式,引入以运动为核心的模型Motion-o,通过结构化运动思维链(MCoT)显式表示物体运动,使用<motion/>标签描述方向、速度与尺度变化。为训练MCoT,将稀疏标注密集化为物体轨迹,并从质心位移与框面积变化中提取运动描述。采用互补奖励机制,包括轨迹一致性与视觉定位奖励,及基于扰动的信号,惩罚在移除时间证据后仍不变的运动描述。在多个视频理解基准上,Motion-o持续提升轨迹忠实性推理表现,且无需架构修改。结果表明,显式运动接口可有效补充现有视觉语言模型流程,将隐式动态转化为可验证证据。代码已开源。

原文摘要 · Abstract (English)

Recent video reasoning models increasingly produce spatio-temporal evidence chains that localize objects at specific timestamps. While these traces improve interpretability by grounding \emph{where} and \emph{when} evidence appears, they often leave the motion connecting observations, the \textit{how}, implicit. This makes dynamic and trajectory-dependent claims difficult to supervise, verify, or penalize when unsupported by the video. We formalize this missing component as Spatial-Temporal-Trajectory (STT) reasoning and introduce \textbf{Motion-o}, a motion-centric extension to vision-language models (VLMs) that makes trajectories explicit and verifiable. Motion-o augments evidence chains with Motion Chain of Thought (MCoT), a structured pathway that represents object motion through a discrete \texttt{<motion/>} tag summarizing direction, speed, and scale change. To supervise MCoT, we densify sparse spatio-temporal annotations into object tracks and derive motion descriptors from centroid displacement and box-area change. We then train with complementary rewards for trajectory consistency and visual grounding, including a perturbation-based signal that penalizes motion descriptions that remain unchanged when temporal evidence is removed. Across multiple video understanding benchmarks, Motion-o consistently improves trajectory-faithful reasoning without architectural modifications. These results suggest that an explicit motion interface can complement existing VLM pipelines by converting implicit dynamics into verifiable evidence. Code is available at~\href{https://github.com/ostadabbas/Motion-o}{\faGithub\ \texttt{ostadabbas/Motion-o}}.

视频推理运动建模可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。