arXiv:2502.14931cs.RO2025-02被引 10

Hier-SLAM++用分层语义表示,实现低成本3D语义建图。

Hier-SLAM++: Neuro-Symbolic Semantic SLAM with a Hierarchically Categorical Gaussian Splatting

  • 构建分层语义树,符号化编码几何与语义信息
  • 支持单目输入,性能媲美主流方法且训练更快
  • 适合资源受限场景的实时3D语义建图应用

我们提出Hier-SLAM++,一种基于分层类别高斯点云的神经符号语义SLAM方法,支持RGB-D与单目输入。该方法通过新型分层结构,在3D高斯点云中紧凑编码语义与几何信息,结合大语言模型(LLMs)与3D生成模型能力,实现端到端的语义符号表示学习。设计了兼顾层内与层间优化的语义损失函数,提升层级语义一致性。提出改进的前馈式SLAM系统,首次实现单目语义高斯点云SLAM,显著降低传感器依赖,扩展应用场景。在合成与真实数据集上实验表明,性能优于或持平现有最优方法,同时大幅减少存储与训练时间开销。

原文摘要 · Abstract (English)

We propose Hier-SLAM++, a comprehensive Neuro-Symbolic semantic 3D Gaussian Splatting SLAM method with both RGB-D and monocular input featuring an advanced hierarchical categorical representation, which enables accurate pose estimation as well as global 3D semantic mapping. The parameter usage in semantic SLAM systems increases significantly with the growing complexity of the environment, making scene understanding particularly challenging and costly. To address this problem, we introduce a novel hierarchical representation that encodes both semantic and geometric information in a compact form into 3D Gaussian Splatting, leveraging the capabilities of large language models (LLMs) as well as the 3D generative model. By utilizing the proposed hierarchical tree structure, semantic information is symbolically represented and learned in an end-to-end manner. We further introduce an advanced semantic loss designed to optimize hierarchical semantic information through both Intra-level and Inter-level optimizations. Additionally, we propose an improved SLAM system to support both RGB-D and monocular inputs using a feed-forward model. To the best of our knowledge, this is the first semantic monocular Gaussian Splatting SLAM system, significantly reducing sensor requirements for 3D semantic understanding and broadening the applicability of semantic Gaussian SLAM system. We conduct experiments on both synthetic and real-world datasets, demonstrating superior or on-par performance with state-of-the-art methods, while significantly reducing storage and training time requirements. Our project page is available at: https://hierslampp.github.io/

语义建图高斯点云单目SLAM神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。