不用大模型也能导航:用射线前沿实现快速零样本物体寻路
R2F: Repurposing Ray Frontiers for LLM-free Object Navigation
- 将射线前沿重定义为带方向的语义假设,作为导航目标
- 在真实机器人上实现毫秒级响应,速度比基于VLM的方法快6倍
- 无需大模型推理,适合实时部署的移动机器人系统
零样本开放词汇物体导航近年来快速发展,主要依赖大型视觉语言模型(VLM)和大型语言模型(LLM)作为高层决策者。然而,这类系统在推理时频繁调用大模型,带来延迟和计算开销,限制了实时部署。为此,本文重新利用近期提出的射线前沿(R2F)探索范式,构建一个无需LLM的室内开放词汇物体导航框架。原射线前沿通过沿射线传播的语义线索引导探索,本文将其重构为显式的、方向相关的语义假设,作为导航目标。在超出范围的射线上积累的语言对齐特征被稀疏存储于前沿区域,每个区域维护多个方向嵌入,编码可能未见内容。导航因此简化为基于嵌入的前沿评分与经典建图规划流程中的目标追踪,避免了迭代的大模型推理。进一步提出R2F-VLN,一种轻量级扩展,通过句法解析与关系验证支持自由形式语言指令,无需额外VLM或LLM。在Habitat-sim和真实机器人平台上的实验表明,该方法达到当前最优的零样本性能,并实现实时运行,最快比基于VLM的方案快6倍。
原文摘要 · Abstract (English)
Zero-shot open-vocabulary object navigation has progressed rapidly with the emergence of large Vision-Language Models (VLMs) and Large Language Models (LLMs), now widely used as high-level decision-makers instead of end-to-end policies. Although effective, such systems often rely on iterative large-model queries at inference time, introducing latency and computational overhead that limit real-time deployment. To address this problem, we repurpose ray frontiers (R2F), a recently proposed frontier-based exploration paradigm, to develop an LLM-free framework for indoor open-vocabulary object navigation. While ray frontiers were originally used to bias exploration using semantic cues carried along rays, we reinterpret frontier regions as explicit, direction-conditioned semantic hypotheses that serve as navigation goals. Language-aligned features accumulated along out-of-range rays are stored sparsely at frontiers, where each region maintains multiple directional embeddings encoding plausible unseen content. In this way, navigation then reduces to embedding-based frontier scoring and goal tracking within a classical mapping and planning pipeline, eliminating iterative large-model reasoning. We further introduce R2F-VLN, a lightweight extension for free-form language instructions using syntactic parsing and relational verification without additional VLM or LLM components. Experiments in Habitat-sim and on a real robotic platform demonstrate competitive state-of-the-art zero-shot performance with real-time execution, achieving up to 6 times faster runtime than VLM-based alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。