arXiv:2503.01646cs.CVcs.AI2025-03ICRA被引 25

用3D高斯点云实现开放集语义建图,支持物体级场景理解。

OpenGS-SLAM: Open-Set Dense Semantic SLAM with 3D Gaussian Splatting for Object-Level Scene Understanding

  • 将2D基础模型标签显式融入3D高斯框架,实现开放集语义建图。
  • 相比现有方法,语义渲染速度提升10倍,存储成本降低50%。
  • 适合需要实时、高效、可扩展语义环境理解的机器人应用。

3D高斯点云技术显著提升了稠密语义SLAM的效率与质量。然而,以往方法受限于预训练分类器类别有限及隐式语义表示,在开放集场景下表现不佳,难以实现物体级场景理解。为此,我们提出OpenGS-SLAM,利用3D高斯表示在开放集环境中进行稠密语义SLAM。系统将来自2D基础模型的显式语义标签融合至3D高斯框架,实现鲁棒的3D物体级场景理解。引入高斯投票点绘技术,实现快速2D标签图渲染与场景更新;提出基于置信度的2D标签一致性方法,确保多视角标注一致;采用分割计数剪枝策略,提升语义表示精度。在合成与真实数据集上的大量实验表明,该方法在场景理解、跟踪与建图方面均有效,相较现有方法实现10倍语义渲染加速与2倍存储成本降低。

原文摘要 · Abstract (English)

Recent advancements in 3D Gaussian Splatting have significantly improved the efficiency and quality of dense semantic SLAM. However, previous methods are generally constrained by limited-category pre-trained classifiers and implicit semantic representation, which hinder their performance in open-set scenarios and restrict 3D object-level scene understanding. To address these issues, we propose OpenGS-SLAM, an innovative framework that utilizes 3D Gaussian representation to perform dense semantic SLAM in open-set environments. Our system integrates explicit semantic labels derived from 2D foundational models into the 3D Gaussian framework, facilitating robust 3D object-level scene understanding. We introduce Gaussian Voting Splatting to enable fast 2D label map rendering and scene updating. Additionally, we propose a Confidence-based 2D Label Consensus method to ensure consistent labeling across multiple views. Furthermore, we employ a Segmentation Counter Pruning strategy to improve the accuracy of semantic scene representation. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of our method in scene understanding, tracking, and mapping, achieving 10 times faster semantic rendering and 2 times lower storage costs compared to existing methods. Project page: https://young-bit.github.io/opengs-github.github.io/.

3D高斯语义建图开放集场景理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。