arXiv:2606.17935cs.CV2026-06International Conf…

单目视频在线重建新方法,提升精度与效率。

MoonSplat: Monocular Online Gaussian Splatting with Sim(3) Global Optimization

论文配图:MoonSplat: Monocular Online Gaussian Splatting with Sim(3) Global Optimization
图 1 · 摘自论文原文
  • 引入Sim(3)全局优化,增强相机位姿跟踪稳定性
  • 在多个数据集上实现最优位姿精度和渲染质量
  • 适合无人机等实时三维重建场景

从单目图像序列进行在线三维重建是持续研究的难题。3D高斯点云(3DGS)凭借其高质量实时渲染能力,使在线重建能以更高表达力表示密集场景,在机器人、AR/VR等领域前景广阔。但现有方法仍面临两大挑战:缺乏全局优化导致相机位姿估计脆弱;大规模或长序列下优化效率低。为此,我们提出一种融合全局Sim(3)优化的体素化3DGS在线重建框架,实现相机位姿与体素化3DGS的可靠追踪与高效全局闭环。为加速体素化3DGS收敛,进一步引入颜色残差学习策略,不仅提升优化速度,还改善渲染质量。在多种室内外数据集上的大量实验表明,该方法在相机位姿估计精度和渲染质量上均达到当前最优水平,同时保持实时性。此外,基于本方法开发并部署了真实世界无人机主动重建系统,验证了其在实际在线三维重建任务中的鲁棒性与泛化能力。代码与数据已开源于https://github.com/TrickyGo/MoonSplat。

原文摘要 · Abstract (English)

Online 3D reconstruction from monocular image sequences is a challenging and ongoing research topic. 3D Gaussian Splatting (3DGS), leveraging its high-quality real-time rendering capability, empowers online 3D reconstruction to represent dense scenes with enhanced expressiveness, and thus holds great promise for a wide range of applications such as robotics and AR/VR. However, existing online 3DGS methods still suffer from some key challenges: fragile camera pose estimation due to the lack of global optimization, and low optimization efficiency in large-scale or long-sequence scenarios. To address these issues, we propose a robust and efficient online voxelized 3DGS reconstruction framework integrated with global $\text{Sim}(3)$ optimization, which enables reliable camera tracking and efficient global loop closure for both camera poses and voxelized 3DGS. To accelerate the convergence of the voxelized 3DGS, we further introduce a color residual learning strategy, which not only boosts optimization speed but also enhances rendering quality. Extensive experiments on diverse indoor and outdoor datasets demonstrate that our method achieves state-of-the-art performance in both camera pose estimation accuracy and rendering quality, while retaining real-time efficiency. Additionally, we develop and deploy a real-world UAV-based active reconstruction system grounded on our proposed method, validating its robustness and generalizability for practical online 3D reconstruction tasks. Our code and data are available at https://github.com/TrickyGo/MoonSplat.

三维重建单目视觉实时系统无人机

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。