用视觉语言模型快速构建场景图,实现零样本机器人导航的高效推理与复用。
VLN-Zero: Rapid Exploration and Cache-Enabled Neurosymbolic Vision-Language Planning for Zero-Shot Transfer in Robot Navigation
- 通过结构化提示引导探索,生成紧凑的符号化场景图。
- 零样本成功率提升2倍,路径规划耗时减半,大模型调用减少55%。
- 适合需要快速适应新环境的自主机器人系统研发者使用。
在未见过的环境中实现快速适应是实现可扩展真实世界自主性的关键,但现有方法依赖耗时的全面探索或僵化的导航策略,难以泛化。本文提出 VLN-Zero,一种两阶段视觉-语言导航框架,利用视觉语言模型(VLM)高效构建符号化场景图,实现零样本神经符号导航。探索阶段,结构化提示引导基于 VLM 的搜索,生成信息丰富且多样化的轨迹,形成紧凑的场景图表示;部署阶段,神经符号规划器基于场景图与环境观测生成可执行计划,缓存启用的执行模块通过复用先前计算的任务-位置轨迹加速适应。该框架结合快速探索、符号推理与缓存执行,克服了以往视觉-语言导航方法的计算低效与泛化差问题,在多种未见环境中实现稳健且可扩展的决策。VLN-Zero 在零样本设置下成功率较最先进模型提升2倍,优于多数微调基线,平均达成目标时间减半,大模型调用次数降低55%。代码、数据集及演示视频见:https://vln-zero.github.io/。
原文摘要 · Abstract (English)
Rapid adaptation in unseen environments is essential for scalable real-world autonomy, yet existing approaches rely on exhaustive exploration or rigid navigation policies that fail to generalize. We present VLN-Zero, a two-phase vision-language navigation framework that leverages vision-language models to efficiently construct symbolic scene graphs and enable zero-shot neurosymbolic navigation. In the exploration phase, structured prompts guide VLM-based search toward informative and diverse trajectories, yielding compact scene graph representations. In the deployment phase, a neurosymbolic planner reasons over the scene graph and environmental observations to generate executable plans, while a cache-enabled execution module accelerates adaptation by reusing previously computed task-location trajectories. By combining rapid exploration, symbolic reasoning, and cache-enabled execution, the proposed framework overcomes the computational inefficiency and poor generalization of prior vision-language navigation methods, enabling robust and scalable decision-making in unseen environments. VLN-Zero achieves 2x higher success rate compared to state-of-the-art zero-shot models, outperforms most fine-tuned baselines, and reaches goal locations in half the time with 55% fewer VLM calls on average compared to state-of-the-art models across diverse environments. Codebase, datasets, and videos for VLN-Zero are available at: https://vln-zero.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。