用隐式语言场实现机器人精准导航,省内存还更准。
LAMP: Implicit Language Map for Robot Navigation
- 用神经隐字段隐式存储语言特征,不占显存
- 粗略规划+梯度优化,精确抵达未直接观察的目标区
- 适合大场景导航,对陌生区域泛化能力强
视觉-语言模型的进展使零样本导航成为可能,让机器人无需标注即可遵循自然语言指令。但现有方法在网格或节点地图中显式存储语言向量,难以扩展到大环境,因内存消耗大且细粒度规划分辨率低。我们提出LAMP(Language Map),一种基于神经隐字段的新型导航框架,学习连续的语言驱动地图,并直接用于细粒度路径生成。与之前方法不同,本方法将语言特征编码为隐式神经场,而非在每个位置显式存储。结合稀疏图结构,LAMP支持高效粗粒度路径规划,再在学习到的场中进行梯度优化以精炼靠近目标的位置。这种从粗到细、语言驱动、梯度引导的优化是首个应用于精准路径生成的隐式语言地图。该优化能有效利用学习特征空间中的语义相似性,选择未被直接观测的目标区域。为进一步增强鲁棒性,采用贝叶斯框架,通过冯·米塞斯-费舍尔分布建模嵌入不确定性,提升对未观测区域的泛化能力。为实现大环境扩展,LAMP采用图采样策略,优先保证空间覆盖和嵌入置信度,仅保留最具信息量的节点,显著降低计算开销。实验结果表明,在NVIDIA Isaac Sim和真实多层建筑环境中,LAMP在内存效率和细粒度目标到达准确率上均优于现有显式方法。
原文摘要 · Abstract (English)
Recent advances in vision-language models have made zero-shot navigation feasible, enabling robots to follow natural language instructions without requiring labeling. However, existing methods that explicitly store language vectors in grid or node-based maps struggle to scale to large environments due to excessive memory requirements and limited resolution for fine-grained planning. We introduce LAMP (Language Map), a novel neural language field-based navigation framework that learns a continuous, language-driven map and directly leverages it for fine-grained path generation. Unlike prior approaches, our method encodes language features as an implicit neural field rather than storing them explicitly at every location. By combining this implicit representation with a sparse graph, LAMP supports efficient coarse path planning and then performs gradient-based optimization in the learned field to refine poses near the goal. This coarse-to-fine pipeline, language-driven, gradient-guided optimization is the first application of an implicit language map for precise path generation. This refinement is particularly effective at selecting goal regions not directly observed by leveraging semantic similarities in the learned feature space. To further enhance robustness, we adopt a Bayesian framework that models embedding uncertainty via the von Mises-Fisher distribution, thereby improving generalization to unobserved regions. To scale to large environments, LAMP employs a graph sampling strategy that prioritizes spatial coverage and embedding confidence, retaining only the most informative nodes and substantially reducing computational overhead. Our experimental results, both in NVIDIA Isaac Sim and on a real multi-floor building, demonstrate that LAMP outperforms existing explicit methods in both memory efficiency and fine-grained goal-reaching accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。