用置信度加权融合深度信息,提升纯视觉3D高斯溅射重建精度
ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM
- 根据多视角一致性动态加权几何与单目先验深度
- 在TUM-RGBD和ScanNet上深度误差降低27%,图像生成质量显著提升
- 适合需要高保真重建的移动设备实时场景建图任务
我们提出ConfidentSplat,一种基于3D高斯溅射(3DGS)的纯RGB SLAM系统,实现鲁棒、高保真的三维重建。针对现有纯视觉3DGS SLAM因深度估计不可靠导致的几何失真问题,该系统引入核心创新:置信度加权融合机制。该机制将多视图几何深度与学习到的单目先验(Omnidata ViT)深度融合,依据显式可靠性估计(主要来自多视角几何一致性)动态调整贡献权重,生成高质量代理深度以指导地图优化。优化后的可变形3DGS地图能在线适应,保持全局一致性,其前端采用受DROID-SLAM启发的位姿估计框架,后端通过回环检测与全局束调整进行优化。在标准基准(TUM-RGBD、ScanNet)及多种自定义移动数据集上的广泛验证表明,该方法在重建精度(L1深度误差)和新视角合成保真度(PSNR、SSIM、LPIPS)方面显著优于基线,尤其在挑战性场景中表现突出。结果证明,基于合理置信度感知的传感器融合策略对推动密集视觉SLAM前沿具有重要意义。
原文摘要 · Abstract (English)
We introduce ConfidentSplat, a novel 3D Gaussian Splatting (3DGS)-based SLAM system for robust, highfidelity RGB-only reconstruction. Addressing geometric inaccuracies in existing RGB-only 3DGS SLAM methods that stem from unreliable depth estimation, ConfidentSplat incorporates a core innovation: a confidence-weighted fusion mechanism. This mechanism adaptively integrates depth cues from multiview geometry with learned monocular priors (Omnidata ViT), dynamically weighting their contributions based on explicit reliability estimates-derived predominantly from multi-view geometric consistency-to generate high-fidelity proxy depth for map supervision. The resulting proxy depth guides the optimization of a deformable 3DGS map, which efficiently adapts online to maintain global consistency following pose updates from a DROID-SLAM-inspired frontend and backend optimizations (loop closure, global bundle adjustment). Extensive validation on standard benchmarks (TUM-RGBD, ScanNet) and diverse custom mobile datasets demonstrates significant improvements in reconstruction accuracy (L1 depth error) and novel view synthesis fidelity (PSNR, SSIM, LPIPS) over baselines, particularly in challenging conditions. ConfidentSplat underscores the efficacy of principled, confidence-aware sensor fusion for advancing state-of-the-art dense visual SLAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。