arXiv:2512.15160cs.CV2025-12中稿 · CVPR被引 1

让AI像人一样看图推理空间关系,能主动选视角补信息。

EagleVision: A Dual-Stage Framework with BEV-grounding-based Chain-of-Thought for Spatial Intelligence

  • 先选关键帧,再迭代提问找最佳视角,形成闭环推理。
  • 在两个数据集上超越现有开源模型,准确率提升显著。
  • 适合需要精准空间理解的自动驾驶、机器人场景。

基于视频的空间推理(如估距、判向、理解多视角布局)需选择有效帧,并在推理中主动获取新视角。现有多模态大模型固定采样帧,无法中途请求新视图,常遗漏几何线索导致判断不准。我们提出EagleVision,一种双阶段框架:第一阶段(宏观感知)采用语义-视角融合的确定性点过程(SPF-DPP),在有限令牌预算下选出兼具语义相关性与视角多样性的关键帧;第二阶段(微观验证)进行迭代式空间思维链推理,每步可文本推理或在鸟瞰图(BEV)平面上预测位姿以检索最近真实帧,形成“假设-查看-验证”闭环。查询策略仅通过强化学习训练,基于空间对齐奖励,无需人工标注推理轨迹。在VSI-Bench和SQA3D数据集上,EagleVision达到开源视觉语言模型的领先性能。

原文摘要 · Abstract (English)

Video-based spatial reasoning -- such as estimating distances, judging directions, or understanding layouts from multiple views -- requires selecting informative frames and, when needed, actively seeking additional viewpoints during inference. Existing multimodal large language models (MLLMs) consume a fixed set of uniformly sampled frames and cannot request new views once reasoning begins, often missing the geometric cues necessary for reliable spatial judgments. We present EagleVision, a dual-stage framework that combines geometry-aware frame selection with active, Bird's-Eye-View (BEV)-grounded reasoning. In the first stage (macro perception), a semantics-perspective-fusion determinantal point process (SPF-DPP) selects a compact set of keyframes that jointly maximize semantic relevance and viewpoint diversity under a fixed token budget. In the second stage (micro verification), the model performs iterative spatial Chain-of-Thought: at each step it can either reason in text or predict a pose on the BEV plane to retrieve the nearest real frame, forming a closed-loop hypothesize-look-verify cycle. The querying policy is trained purely via reinforcement learning with a spatial grounding reward, requiring no human-annotated reasoning traces. On VSI-Bench and SQA3D, EagleVision achieves state-of-the-art performance among open-source vision-language models.

空间推理视觉语言模型主动感知鸟瞰图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。