arXiv:2509.10454cs.ROcs.CV2025-09中稿 · CoRL被引 10

将导航指令转为图约束,无需训练即可在新环境自主导航。

GC-VLN: Instruction as Graph Constraints for Training-free Vision-and-Language Navigation

  • 把指令拆解成空间关系图,用约束求解确定路径点。
  • 在标准基准上成功率显著优于现有零样本方法。
  • 适合希望快速部署到真实场景的机器人导航研究者。

本文提出一种无需训练的视觉-语言导航框架(GC-VLN)。现有零样本导航方法多针对离散环境或需在连续模拟器中无监督训练,难以推广至真实场景。为实现在连续环境中的免训练导航,本框架将导航指引建模为图约束优化问题,通过将指令分解为显式空间约束来实现。该约束驱动范式通过求解约束获取航路点位置,生成机器人导航路径与目标点。我们构建了涵盖所有常见空间关系的空间约束库;将人类指令解析为有向无环图,包含航路点、物体节点及边,作为查询检索约束库以建立图约束。通过约束求解器优化图约束,确定航路点位置。针对无解或多解情况,设计导航树与回溯机制。大量实验表明,本方法在标准基准上的成功率和导航效率均显著优于当前最优零样本方法。进一步的真实世界实验显示,框架能有效泛化至新环境与指令集,为更鲁棒、自主的导航系统铺平道路。

原文摘要 · Abstract (English)

In this paper, we propose a training-free framework for vision-and-language navigation (VLN). Existing zero-shot VLN methods are mainly designed for discrete environments or involve unsupervised training in continuous simulator environments, which makes it challenging to generalize and deploy them in real-world scenarios. To achieve a training-free framework in continuous environments, our framework formulates navigation guidance as graph constraint optimization by decomposing instructions into explicit spatial constraints. The constraint-driven paradigm decodes spatial semantics through constraint solving, enabling zero-shot adaptation to unseen environments. Specifically, we construct a spatial constraint library covering all types of spatial relationship mentioned in VLN instructions. The human instruction is decomposed into a directed acyclic graph, with waypoint nodes, object nodes and edges, which are used as queries to retrieve the library to build the graph constraints. The graph constraint optimization is solved by the constraint solver to determine the positions of waypoints, obtaining the robot's navigation path and final goal. To handle cases of no solution or multiple solutions, we construct a navigation tree and the backtracking mechanism. Extensive experiments on standard benchmarks demonstrate significant improvements in success rate and navigation efficiency compared to state-of-the-art zero-shot VLN methods. We further conduct real-world experiments to show that our framework can effectively generalize to new environments and instruction sets, paving the way for a more robust and autonomous navigation framework.

视觉语言导航零样本学习图约束机器人导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。