arXiv:2607.01754cs.AI2026-07中稿 · ECCV

让导航模型在探索中自动生成匹配路径的指令,提升弱监督下的学习效率。

Path-level Hindsight Instructions for Semantic Exploration in Vision-Language Navigation

论文配图:Path-level Hindsight Instructions for Semantic Exploration in Vision-Language Navigation
图 1 · 摘自论文原文
  • 通过事后推理生成与实际路径匹配的语义指令,解决探索偏离原指令的问题。
  • 在R2R-CE和RxR-CE上性能媲美现有方法,仅需少量专家示范数据。
  • 适合数据稀缺场景下视觉语言导航任务的高效训练,尤其适用于少样本学习。

在策略探索是训练鲁棒视觉语言导航(VLN)智能体的关键环节,因为它使策略暴露于更广泛的状态分布。然而,这种探索不可避免地导致轨迹偏离专家示范,造成执行的视觉流与原始语言指令之间的语义不匹配。本文提出Phi-Nav,一个统一的在策略框架,利用事后推理将指令与智能体的实际探索路径对齐。具体而言,Phi-Nav采用三阶段双监督循环:1)智能体在理想引导下进行在策略探索,同时从专家动作反馈中学习;2)事后说话者基于收集的视觉观测生成路径级的事后指令;3)智能体执行第二次模仿学习,将合成的轨迹-指令对视为额外的专家示范。该过程弥合了在策略方法固有的语义监督缺口,将原本无语义标注的移动转化为密集训练信号。在R2R-CE和RxR-CE基准上的评估表明,Phi-Nav在仅使用极少专家示范的情况下,仍能取得具有竞争力的性能。结果凸显了语义探索在VLN中的必要性,证明了Phi-Nav是在数据有限条件下训练具身智能体的有效方案。

原文摘要 · Abstract (English)

On-policy exploration is a crucial component for training robust Vision-Language Navigation agents, as it exposes the policy to a broader state distribution. However, such exploration inevitably leads to trajectories that deviate from expert demonstrations, resulting in a semantic mismatch between the executed visual stream and the original language instruction. In this work, we address this challenge by introducing Phi-Nav, a unified on-policy framework that leverages hindsight reasoning to align instructions with the agent's actual exploratory journey. Specifically, Phi-Nav operates through a three-stage dual-supervision cycle: 1) the agent performs oracle-guided on-policy exploration, sampling a trajectory while learning from expert action feedback, 2) a hindsight speaker synthesizes a path-level hindsight instruction grounded in the collected visual observations, and 3) the agent conducts a second imitation pass, treating the synthesized trajectory-instruction pair as an additional expert demonstration. Through this process, Phi-Nav bridges the critical semantic supervision gap inherent in on-policy methods, transforming semantically unlabeled movement into dense training signals. Evaluations on the R2R-CE and RxR-CE benchmarks show that Phi-Nav yields competitive performance while requiring only a fraction of the expert demonstrations used by current baselines. These results underscore the necessity of semantic exploration in VLN, positioning Phi-Nav as an effective solution for training embodied agents with limited data.

视觉语言导航强化学习少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。