用多相机旋转数据提升3D高斯点云的定位精度与渲染效果
Robust Gaussian Splatting SLAM by Leveraging Loop Closure

- 通过时间锚定区分历史与新高斯点,实现更精准的闭环检测
- 闭环优化后相机位姿误差显著降低,3D模型质量保持稳定
- 适合需要高精度定位与逼真渲染的移动机器人场景
3D高斯点云算法在新视角生成中表现优异,并被用于扩展传统SLAM系统的功能。然而,现有高斯点云SLAM方法主要针对手持式RGB或RGB-D传感器设计,在旋转式RGB-D相机设置下容易出现跟踪漂移。本文提出一种鲁棒的高斯点云SLAM架构,利用多台旋转的RGB-D相机输入,实现高精度定位与逼真渲染。所提出的高斯点云闭环模块有效解决传统方法中累积的跟踪与建图误差问题:每个高斯点关联一个参考帧,并根据时间戳分为历史或新类型;在相同视角下渲染不同类型的高斯点,结合共视关系与渲染差异进行闭环检测。进一步提出闭环优化方法,采用轻量级位姿图优化修正位姿漂移,并基于优化后的位姿更新高斯点。此外,引入捆绑调整方案,结合光度与几何约束进一步优化相机位姿,提升全局一致性。在合成与真实数据集上的定量与定性评估表明,本方法在相机位姿估计与新视角渲染任务上均优于当前最先进方法。
原文摘要 · Abstract (English)
3D Gaussian Splatting algorithms excel in novel view rendering applications and have been adapted to extend the capabilities of traditional SLAM systems. However, current Gaussian Splatting SLAM methods, designed mainly for hand-held RGB or RGB-D sensors, struggle with tracking drifts when used with rotating RGB-D camera setups. In this paper, we propose a robust Gaussian Splatting SLAM architecture that utilizes inputs from rotating multiple RGB-D cameras to achieve accurate localization and photorealistic rendering performance. The carefully designed Gaussian Splatting Loop Closure module effectively addresses the issue of accumulated tracking and mapping errors found in conventional Gaussian Splatting SLAM systems. First, each Gaussian is associated with an anchor frame and categorized as historical or novel based on its timestamp. By rendering different types of Gaussians at the same viewpoint, the proposed loop detection strategy considers both co-visibility relationships and distinct rendering outcomes. Furthermore, a loop closure optimization approach is proposed to remove camera pose drift and maintain the high quality of 3D Gaussian models. The approach uses a lightweight pose graph optimization algorithm to correct pose drift and updates Gaussians based on the optimized poses. Additionally, a bundle adjustment scheme further refines camera poses using photometric and geometric constraints, ultimately enhancing the global consistency of scenarios. Quantitative and qualitative evaluations on both synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art methods in camera pose estimation and novel view rendering tasks. The code will be open-sourced for the community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。