单目实时三维重建新方法,兼顾速度、精度与内存效率。
MGSO: Monocular Real-time Photometric SLAM with Efficient 3D Gaussian Splatting
- 用光度SLAM生成稠密点云,快速初始化3D高斯斑点
- 在相同硬件下,重建质量优于当前最优系统
- 仅需彩色图像输入,适合机器人与AR等实时场景
单目实时稀疏-稠密三维重建在资源受限设备上仍具挑战性。最近的3D高斯斑点(3DGS)技术为实时稠密重建提供了新思路。然而,现有基于3DGS的SLAM系统难以兼顾硬件简单性、速度与地图质量:多数系统在某一方面表现突出,但难以全面均衡。核心难点在于3D高斯的初始化与SLAM过程难以同步。为此,我们提出单目光度SLAM系统(MGSO),将光度SLAM与3DGS融合。光度SLAM提供稠密结构化点云用于3DGS初始化,加速优化并生成更高效的地图(高斯数量更少)。实验表明,本系统在重建质量、内存效率和速度之间取得良好平衡,性能超越当前最先进方法。此外,所有结果仅依赖RGB输入,在Replica、TUM-RGBD和EuRoC数据集上验证,且在笔记本电脑硬件上保持稳定性能,适用于机器人、AR等实时应用。
原文摘要 · Abstract (English)
Real-time SLAM with dense 3D mapping is computationally challenging, especially on resource-limited devices. The recent development of 3D Gaussian Splatting (3DGS) offers a promising approach for real-time dense 3D reconstruction. However, existing 3DGS-based SLAM systems struggle to balance hardware simplicity, speed, and map quality. Most systems excel in one or two of the aforementioned aspects but rarely achieve all. A key issue is the difficulty of initializing 3D Gaussians while concurrently conducting SLAM. To address these challenges, we present Monocular GSO (MGSO), a novel real-time SLAM system that integrates photometric SLAM with 3DGS. Photometric SLAM provides dense structured point clouds for 3DGS initialization, accelerating optimization and producing more efficient maps with fewer Gaussians. As a result, experiments show that our system generates reconstructions with a balance of quality, memory efficiency, and speed that outperforms the state-of-the-art. Furthermore, our system achieves all results using RGB inputs. We evaluate the Replica, TUM-RGBD, and EuRoC datasets against current live dense reconstruction systems. Not only do we surpass contemporary systems, but experiments also show that we maintain our performance on laptop hardware, making it a practical solution for robotics, A/R, and other real-time applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。