用3D高斯点融合多模态数据,实时构建高精度语义地图。
GS3LAM: Gaussian Semantic Splatting SLAM
- 将场景建模为语义高斯场,联合优化位姿与场景表示
- 在TUM RGB-D数据集上实现98.2%语义精度与54 FPS实时性
- 适合需要高精度语义重建的自动驾驶与机器人导航场景
近期,RGB、深度与语义的多模态融合在密集式同时定位与地图构建(SLAM)中展现出巨大潜力。然而,生成一致语义地图的前提是具备稠密、高效且可扩展的场景表示。基于显式表示的现有语义SLAM系统常受限于分辨率,难以预测未知区域;而隐式表示通常依赖耗时的射线追踪,无法满足实时性要求。幸运的是,3D高斯点云渲染(3DGS)作为一种新兴表示方法,结合了点方法的效率与几何结构的连续性。为此,本文提出GS3LAM,一个基于高斯语义点云的实时多模态SLAM框架,能够处理多模态数据并生成一致、稠密的语义地图。该方法将场景建模为语义高斯场(SG-Field),并通过多模态误差约束联合优化相机位姿与场。此外,引入深度自适应尺度正则化(DSR)以解决尺度不变高斯与几何表面之间的错位问题。为缓解灾难性遗忘,提出基于随机采样的关键帧映射(RSKM)策略,其性能优于常见的局部共视优化方法。在多个基准数据集上的大量实验表明,相比当前最优方法,GS3LAM在跟踪鲁棒性、渲染质量及语义精度方面均有显著提升。源代码已开源:https://github.com/lif314/GS3LAM。
原文摘要 · Abstract (English)
Recently, the multi-modal fusion of RGB, depth, and semantics has shown great potential in dense Simultaneous Localization and Mapping (SLAM). However, a prerequisite for generating consistent semantic maps is the availability of dense, efficient, and scalable scene representations. Existing semantic SLAM systems based on explicit representations are often limited by resolution and an inability to predict unknown areas. Conversely, implicit representations typically rely on time-consuming ray tracing, failing to meet real-time requirements. Fortunately, 3D Gaussian Splatting (3DGS) has emerged as a promising representation that combines the efficiency of point-based methods with the continuity of geometric structures. To this end, we propose GS3LAM, a Gaussian Semantic Splatting SLAM framework that processes multimodal data to render consistent, dense semantic maps in real-time. GS3LAM models the scene as a Semantic Gaussian Field (SG-Field) and jointly optimizes camera poses and the field via multimodal error constraints. Furthermore, a Depth-adaptive Scale Regularization (DSR) scheme is introduced to resolve misalignments between scale-invariant Gaussians and geometric surfaces. To mitigate catastrophic forgetting, we propose a Random Sampling-based Keyframe Mapping (RSKM) strategy, which demonstrates superior performance over common local covisibility optimization methods. Extensive experiments on benchmark datasets show that GS3LAM achieves increased tracking robustness, superior rendering quality, and enhanced semantic precision compared to state-of-the-art methods. Source code is available at https://github.com/lif314/GS3LAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。