arXiv:2607.12680cs.CV2026-07

让AI导航有自我反思能力,错能改、路更准

ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning

论文配图:ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning
图 1 · 摘自论文原文
  • 用双向交互的意图与执行代理实现闭环纠错
  • 在标准数据集上成功率提升,路径更高效
  • 适合需要可解释决策的智能导航系统研究

现有视觉语言导航方法通常将视觉语言模型与航点解码器耦合生成多步动作计划,但缺乏显式的闭环机制来追踪语义进展、诊断执行失败并应对长程导航中的误差累积。为此,我们提出ReflectVLN,一种通过双向交互的意图与执行代理组织决策的智能体框架。意图代理负责子任务分解与反思,生成可执行的子任务描述作为修正计划;执行代理在当前观测下将这些描述转化为短时动作,同时监控子目标进展并检测偏离行为。关键在于,ReflectVLN支持闭环双向通信:执行代理发出进度与偏差信号,触发意图代理的反思与子任务更新;意图代理返回结构化指导,重新条件化后续动作以实现恢复。为促进时间连贯且可解释的中间推理,我们引入动作链思维(Action-CoT),一种路径条件下的双查询训练方案。在标准VLN基准上的实验表明,ReflectVLN在受限数据预算下提升了成功率与路径效率,训练成本低,推理时高阶意图调用次数少,同时提供可分析与协作的中间决策。代码已开源。

原文摘要 · Abstract (English)

Existing vision-language navigation methods often couple a VLM with waypoint decoders to produce multi-step action plans, but they typically lack an explicit closed-loop mechanism for tracking semantic progress, diagnosing execution failures, and recovering from error accumulation in long-horizon navigation. To address this gap, we propose ReflectVLN, an agentic VLN framework that organizes decision-making through bidirectionally interactive intention and execution agents. The intention agent performs subtask decomposition and reflection, generating executable subtask descriptions as corrective plans. Conditioned on these descriptions, the execution agent grounds them into short-horizon actions under current observations while monitoring sub-goal progress and detecting off-track behavior. Crucially, ReflectVLN enables closed-loop bidirectional communication: the execution agent emits progress and deviation signals to trigger reflection and subtask updates on demand, and the intention agent returns structured guidance that reconditions subsequent actions for recovery. To encourage temporally coherent decisions with interpretable intermediate rationales, we introduce Action Chain-of-Thought (Action-CoT), a path-conditioned dual-query training scheme for action generation. Experiments on standard VLN benchmarks show that ReflectVLN improves success rates and path efficiency under a constrained data budget, with favorable training cost and fewer high-level intention calls at inference time, while providing interpretable intermediate decisions for analysis and collaboration. Code is available at: https://github.com/AIprogrammer/ReflectVLN

视觉导航自我反思可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。