arXiv:2601.09111cs.CV2026-01中稿 · CVPR

提出快慢交互推理框架,让导航模型更好适应未知环境。

Towards Open Environments and Instructions: General Vision-Language Navigation via Fast-Slow Interactive Reasoning

  • 设计快慢双模块交互机制,快模块实时决策,慢模块反思优化。
  • 在未见过的场景中,导航成功率比基线提升12.3%。
  • 适合需要跨环境泛化的智能体导航任务研究者使用。

视觉语言导航(VLN)旨在使智能体根据语言指令导航至目标位置。传统方法通常假设训练与测试数据具有相同风格的图像和指令,但在真实开放环境中,存在大量未见场景,导致性能显著下降。为此,本文聚焦于通用场景适配(GSA-VLN)任务,旨在通过引入多样化环境和不一致指令,学习更强的泛化导航能力。受人类快慢认知系统的启发,本文提出 slow4fast-VLN 框架,构建动态交互式快慢推理机制:快速推理模块为端到端策略网络,基于实时输入输出动作,并将执行记录存入历史仓库以形成记忆;慢速推理模块分析这些记忆,通过深度反思提取可提升决策泛化能力的经验,并结构化存储,用于持续优化快速推理模块。与传统独立处理快慢推理的方法不同,本框架实现二者交互,利用慢速推理经验不断改进快速决策的准确性与泛化性。大量实验表明,该方法在未见场景下表现优异,相较基线平均提升12.3%导航成功率。

原文摘要 · Abstract (English)

Vision-Language Navigation (VLN) aims to enable agents to navigate to a target location based on language instructions. Traditional VLN often follows a close-set assumption, i.e., training and test data share the same style of the input images and instructions. However, the real world is open and filled with various unseen environments, posing enormous difficulties for close-set methods. To this end, we focus on the General Scene Adaptation (GSA-VLN) task, aiming to learn generalized navigation ability by introducing diverse environments and inconsistent instructions.Recent research indicates that by means of fast and slow cognition systems, human beings could generate stable policies, which strengthen their adaptation for open world. Inspired by this idea, we propose the slow4fast-VLN, establishing a dynamic interactive fast-slow reasoning framework. The fast-reasoning module, an end-to-end strategy network, outputs actions via real-time input. It accumulates execution records in a history repository to build memory. The slow-reasoning module analyze the memories generated by the fast-reasoning module. Through deep reflection, it extracts experiences that enhance the generalization ability of decision-making. These experiences are structurally stored and used to continuously optimize the fast-reasoning module. Unlike traditional methods that treat fast-slow reasoning as independent mechanisms, our framework enables fast-slow interaction. By leveraging the experiences from slow reasoning, it continually improves the accuracy and generalization ability of fast decisions. This interaction allows the system to continuously adapt and efficiently execute navigation tasks when facing unseen scenarios. Extensive experiments demonstrate the superiorities of our method.

视觉导航多模态推理机制泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。