用语言+高斯点构建多尺度环境地图,零样本导航更准更快。
Multi-Scale Gaussian-Language Map for Zero-shot Embodied Navigation and Reasoning

- 融合语言描述与3D高斯表示,实现几何与语义统一建模。
- 在三类任务上零样本提升导航精度与上下文推理能力。
- 适合做智能体导航、具身智能的开发者和研究者使用。
理解环境的几何与语义结构对具身导航与推理至关重要。现有语义地图方法在显式几何与多尺度语义之间存在权衡,且缺乏与大模型原生接口,需额外训练特征投影进行对齐。为此,我们提出多尺度高斯-语言地图(GLMap),包含三大设计:(1) 显式几何表示,(2) 覆盖实例与区域概念的多尺度语义,(3) 双模态接口,每个语义单元同时存储自然语言描述与3D高斯表示。3D高斯支持通过高斯喷洒实现紧凑存储与快速渲染任务相关图像。为实现高效增量构建,我们进一步提出高斯估计算法,无需梯度优化即可从密集点云解析出高斯参数。在ObjectNav、InstNav和SQA任务上的实验表明,GLMap有效提升目标导航与上下文推理性能,同时兼容基于大模型的方法,支持零样本应用。代码已开源:https://github.com/sx-zhang/GLMap。
原文摘要 · Abstract (English)
Understanding the geometric and semantic structure of environments is essential for embodied navigation and reasoning. Existing semantic mapping methods trade off between explicit geometry and multi-scale semantics, and lack a native interface for large models, thus requiring additional training of feature projection for semantic alignment. To this end, we propose the multi-scale Gaussian-Language Map (GLMap), which introduces three key designs: (1) explicit geometry, (2) multi-scale semantics covering both instance and region concepts, and (3) a dual-modality interface where each semantic unit jointly stores a natural language description and a 3D Gaussian representation. The 3D Gaussians enable compact storage and fast rendering of task-relevant images via Gaussian splatting. To enable efficient incremental construction, we further propose a Gaussian Estimator that analytically derives Gaussian parameters from dense point clouds without gradient-based optimization. Experiments on ObjectNav, InstNav, and SQA tasks show that GLMap effectively enhances target navigation and contextual reasoning, while remaining compatible with large-model-based methods in a zero-shot manner. The code is available at https://github.com/sx-zhang/GLMap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。