用混合表示法让3D重建速度突破150帧,比现有方法快10倍
Gaussian-Plus-SDF SLAM: High-fidelity 3D Reconstruction at 150+ fps
- 结合SDF与高斯点,分担几何与细节建模任务
- 减少50%高斯点数和75%优化迭代次数
- 实测150+帧/秒,适合实时三维重建场景
尽管基于高斯的SLAM方法能实现逼真的三维重建,但其计算性能仍是关键瓶颈。当前最先进方法帧率低于20帧,远落后于几何类方法(如KinectFusion,可达数百帧)。这源于高昂的计算开销:需大量高斯点并进行复杂迭代优化以拟合RGB-D数据;若高斯点数或优化次数不足,重建质量将严重下降。为此,我们提出高斯-SDF混合表示:用带颜色的有符号距离场(SDF)处理平滑几何与外观,同时用3D高斯捕捉未充分建模的细节。SDF通过类似几何方法的RGB-D融合高效构建,而高斯点仅进行局部外观优化。该表示使高斯点数量减少50%,优化迭代次数减少75%。基于此,我们构建了GPS-SLAM系统,在真实Azure Kinect序列上实现超过150帧/秒的实时重建,相比现有方法提速一个量级,且重建质量相当。代码与数据见https://gapszju.github.io/GPS-SLAM。
原文摘要 · Abstract (English)
While recent Gaussian-based SLAM methods achieve photorealistic reconstruction from RGB-D data, their computational performance remains a critical bottleneck. State-of-the-art techniques operate at less than 20 fps, significantly lagging behind geometry-based approaches like KinectFusion (hundreds of fps). This limitation stems from the heavy computational burden: modeling scenes requires numerous Gaussians and complex iterative optimization to fit RGB-D data; insufficient Gaussian counts or optimization iterations cause severe quality degradation. To address this, we propose a Gaussian-SDF hybrid representation, combining a colorized signed distance field (SDF) for smooth geometry and appearance with 3D Gaussians to capture underrepresented details. The SDF is efficiently constructed via RGB-D fusion (as in geometry-based methods), while Gaussians undergo iterative optimization. Our representation enables significant Gaussian reduction (50% fewer) by avoiding full-scene Gaussian modeling, and efficient Gaussian optimization (75% fewer iterations) through targeted appearance refinement. Building upon this representation, we develop GPS-SLAM (Gaussian-plus-SDF SLAM), a real-time 3D reconstruction system achieving over 150 fps on real-world Azure Kinect sequences, faster by an order-of-magnitude than state-of-the-art techniques while maintaining comparable reconstruction quality. The source code and data are available at https://gapszju.github.io/GPS-SLAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。