让视觉语言导航更流畅,减少机器人停顿等待时间。
LiveVLN: Breaking the Stop-and-Go Loop in Vision-Language Navigation

- 不中断执行,提前规划多步动作并重叠处理新感知
- 实测减少77.7%等待时间,部署时长缩短19.6%
- 无需重新训练,可无缝接入现有导航模型
当前导航系统在基准测试中表现优异,但在真实场景中仍频繁出现停顿。根本原因在于感知-推理-执行循环阻塞:每次新观测后,控制器必须等待感知、传输与推理完成才能继续行动。仅降低动作生成成本无法消除冗余等待。为此,我们提出LiveVLN——一种无需训练的连续具身导航框架,通过为预训练视觉语言导航器添加多步动作延续机制,实现执行与新观测处理的重叠。无需等待完整推理即可提前交付未来动作,保持运动过程中动作持续可用,显著减少空闲等待时间,提升在线执行流畅性。该框架运行于实时环境,可集成至兼容的预训练VLM导航器。在R2R和RxR数据集上,LiveVLN保持原有性能的同时,降低等待时间并提升动作可用性。在真实部署中,平均停机时间减少达77.7%,流式导航(StreamVLN)和NaVIDA系统的总耗时分别缩短12.6%和19.6%,显著提升执行连贯性。代码已开源:https://github.com/NIneeeeeem/LiveVLN。
原文摘要 · Abstract (English)
Recent navigation systems achieve strong benchmark results, yet real-world deployment often remains visibly stop-and-go. This bottleneck arises because the sense-inference-execution loop is still blocking: after each new observation, the controller must wait for sensing, transmission, and inference before motion can continue. Reducing action-generation cost alone therefore does not remove redundant waiting. To address this issue, we present LiveVLN, a training-free framework for more continuous embodied navigation by augmenting pretrained VLM navigators with multi-step action continuation. Instead of pausing for each full sense-and-inference round, LiveVLN overlaps execution with the processing of newly arrived observations, allowing refreshed future actions to be handed off before the current executable prefix is exhausted. This design keeps actions continuously available during motion, reducing idle waiting and enabling smoother online execution. The framework operates at runtime and can be integrated with compatible pretrained VLM navigators. Across R2R and RxR, LiveVLN preserves benchmark performance while reducing waiting time and improving action availability. In real-world deployments, it cuts average episode waiting time by up to $77.7\%$ and shortens wall-clock episode time by $12.6\%$ on StreamVLN and $19.6\%$ on NaVIDA, yielding more coherent execution during deployment. Code is available at https://github.com/NIneeeeeem/LiveVLN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。