arXiv:2605.18209cs.CVcs.AI2026-05

动态路由提示词,让模型零样本理解视频中的空间关系。

SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning

论文配图:SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning
图 1 · 摘自论文原文
  • 根据问题类型自动匹配专属提示模板,无需训练或3D数据。
  • 在SQA3D上提升准确率最高达5%,超越固定提示基线。
  • 适合做零样本视频空间推理的科研与工程应用。

对第一人称视频进行空间问答是一项挑战性任务,要求视觉-语言模型(VLMs)推理三维物体位置、场景可用性及方向关系,尤其在无任务微调的零样本设置下。我们提出SpatioRoute,一种动态提示生成方法,将每个输入问题路由至语义定制的提示模板——无需额外训练、微调或3D传感器输入。SpatioRoute包含两种互补模式:基于规则的SpatioRoute-R,可确定性地将问题类型(如What、Is、How、Can、Which)映射到专用提示模板;以及基于大模型的SpatioRoute-L,仅凭问题和情境上下文生成任务特定提示,路由时无需视频输入。我们在涵盖多个模型家族的SQA3D基准上评估SpatioRoute,结果表明其相较固定提示基线实现高达5%的准确率提升,建立了无需3D点云输入的纯视频零样本空间问答新基准。此外,我们发现通过Think it Twice架构实现的思维链(CoT)提示在Qwen系列模型上反而持续降低性能,证实针对问题的提示路由比统一推理指令更有效于空间视频理解。

原文摘要 · Abstract (English)

Spatial question answering over egocentric video is a challenging task that requires Vision-Language Models (VLMs) to reason about 3D object positions, scene affordances, and directional relationships, particularly in the zero-shot setting where no task-specific fine-tuning is available. We introduce SpatioRoute, a dynamic prompt generation approach that routes each incoming question to a semantically tailored prompt template -- without any additional training, fine-tuning, or 3D sensor input. SpatioRoute operates in two complementary modes: SpatioRoute-R, a rule-based router that deterministically maps question typologies (e.g., What, Is, How, Can, Which) to specialized prompt templates; and SpatioRoute-L, an LLM-driven approach that generates task-specific prompts from the question and situational context alone, with no video input at routing time. We evaluate SpatioRoute on the SQA3D benchmark across VLMs spanning model families. SpatioRoute achieves consistent overall accuracy gains up to 5% over fixed prompt baselines, establishing a new state-of-the-art for zero-shot video-only spatial VQA without requiring 3D point-cloud inputs. As an additional finding, we observe that Chain-of-Thought (CoT) prompting, implemented via the Think it Twice architecture, consistently degrades performance in this setting on Qwen series models, confirming that question-aware routing is more effective than uniform reasoning instructions for spatial video understanding.

空间推理提示路由零样本视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。