实时高保真三维重建,用高效高斯点云实现单目与双目相机的快速定位
RP-SLAM: Real-time Photorealistic SLAM with Efficient 3D Gaussian Splatting
- 分离位姿估计与高斯点优化,提升系统效率
- 动态窗口优化缓解记忆丢失,保持地图一致性
- 单目初始化基于稀疏点云,提升初始精度适合实际应用
3D高斯点云渲染技术因其高质量表现受到关注,但现有方法存在高斯原语冗余、连续优化中遗忘问题以及单目情况下因缺乏深度信息难以初始化等问题。为此,我们提出RP-SLAM,一种基于3D高斯点云的单目与RGB-D视觉SLAM方法。该方法将相机位姿估计与高斯原语优化解耦,包含三个核心组件:首先,采用自适应采样和高斯原语过滤的增量式映射方法,实现紧凑且准确的场景表示;其次,提出动态窗口优化策略,缓解遗忘问题并提升地图一致性;最后,针对单目情况,设计基于稀疏点云的关键帧初始化方法,为后续优化提供几何基础。大量实验表明,RP-SLAM在保证实时性能的同时,实现了当前最佳的地图渲染精度与模型紧凑性。
原文摘要 · Abstract (English)
3D Gaussian Splatting has emerged as a promising technique for high-quality 3D rendering, leading to increasing interest in integrating 3DGS into realism SLAM systems. However, existing methods face challenges such as Gaussian primitives redundancy, forgetting problem during continuous optimization, and difficulty in initializing primitives in monocular case due to lack of depth information. In order to achieve efficient and photorealistic mapping, we propose RP-SLAM, a 3D Gaussian splatting-based vision SLAM method for monocular and RGB-D cameras. RP-SLAM decouples camera poses estimation from Gaussian primitives optimization and consists of three key components. Firstly, we propose an efficient incremental mapping approach to achieve a compact and accurate representation of the scene through adaptive sampling and Gaussian primitives filtering. Secondly, a dynamic window optimization method is proposed to mitigate the forgetting problem and improve map consistency. Finally, for the monocular case, a monocular keyframe initialization method based on sparse point cloud is proposed to improve the initialization accuracy of Gaussian primitives, which provides a geometric basis for subsequent optimization. The results of numerous experiments demonstrate that RP-SLAM achieves state-of-the-art map rendering accuracy while ensuring real-time performance and model compactness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。