arXiv:2506.02741cs.CV2025-06ICML被引 8

用视图绑定高斯表示法,实现大场景下高效精准的RGBD SLAM。

VTGaussian-SLAM: RGBD SLAM for Large Scale Scenes with Splatting View-Tied 3D Gaussians

  • 将高斯分布与深度像素绑定,减少参数量节省显存。
  • 在有限显存下支持更多高斯点,提升局部细节表达能力。
  • 无需全程优化所有高斯参数,兼顾精度与可扩展性,适合大场景建图。

从RGBD图像中联合估计相机位姿并构建场景地图是同步定位与建图(SLAM)的核心任务。当前先进方法使用3D高斯表示场景,并通过光栅化(splatting)进行渲染以提高效率和画质。然而,这些方法难以扩展至超大场景,因追踪与建图策略需在有限显存下持续优化所有3D高斯,以维持几何与颜色一致性。为此,本文提出新型追踪与建图策略,结合一种新3D表示——视图绑定3D高斯(view-tied 3D Gaussians)。该表示将高斯与深度像素绑定,无需学习位置、旋转及多维方差,显著降低存储开销。绑定到视图使我们可在有限显存下使用更多高斯表示局部细节。同时,新策略无需全程保持所有高斯可学习,反而提升了渲染质量与追踪精度。我们在多个主流基准上验证了其有效性,性能优于最新方法,在渲染质量、追踪精度与可扩展性方面均表现更优。

原文摘要 · Abstract (English)

Jointly estimating camera poses and mapping scenes from RGBD images is a fundamental task in simultaneous localization and mapping (SLAM). State-of-the-art methods employ 3D Gaussians to represent a scene, and render these Gaussians through splatting for higher efficiency and better rendering. However, these methods cannot scale up to extremely large scenes, due to the inefficient tracking and mapping strategies that need to optimize all 3D Gaussians in the limited GPU memories throughout the training to maintain the geometry and color consistency to previous RGBD observations. To resolve this issue, we propose novel tracking and mapping strategies to work with a novel 3D representation, dubbed view-tied 3D Gaussians, for RGBD SLAM systems. View-tied 3D Gaussians is a kind of simplified Gaussians, which is tied to depth pixels, without needing to learn locations, rotations, and multi-dimensional variances. Tying Gaussians to views not only significantly saves storage but also allows us to employ many more Gaussians to represent local details in the limited GPU memory. Moreover, our strategies remove the need of maintaining all Gaussians learnable throughout the training, while improving rendering quality, and tracking accuracy. We justify the effectiveness of these designs, and report better performance over the latest methods on the widely used benchmarks in terms of rendering and tracking accuracy and scalability. Please see our project page for code and videos at https://machineperceptionlab.github.io/VTGaussian-SLAM-Project .

SLAM3D高斯大场景建图RGBD

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。