arXiv:2501.08286cs.ROcs.CV2025-01被引 26

用手机摄像头+低频陀螺仪实现实时大场景3D重建,精度超现有方法。

VINGS-Mono: Visual-Inertial Gaussian Splatting Monocular SLAM in Large Scenes

  • 融合视觉与惯性信息,通过高斯点云增量构建2D地图
  • 支持5000万高斯椭球的大场景建图,定位精度媲美顶级里程计
  • 创新利用新视角生成检测回环,适合户外千米级真实场景

VINGS-Mono 是一种面向大场景的单目(惯性)高斯点云(GS)SLAM框架,包含四个核心模块:视觉惯性前端、2D高斯地图、基于新视角合成(NVS)的回环闭合模块和动态擦除器。视觉惯性前端通过密集捆绑调整与不确定性估计提取场景几何与位姿;映射模块基于此结果,使用基于采样的光栅化器、评分管理器与位姿优化,逐步构建并维护2D高斯地图,可处理高达5000万高斯椭球的大规模城市环境。为保证全局一致性,提出基于高斯点云新视角合成能力的回环闭合机制,实现地图修正。同时引入动态擦除器应对真实室外场景中的动态物体。在室内外环境下广泛验证表明,本方法定位性能达到视觉惯性里程计水平,显著超越近期高斯/神经辐射场(NeRF)SLAM方法,在建图与渲染质量上全面领先。此外,我们开发了移动端应用,证实仅使用智能手机摄像头与低频IMU即可实时生成高质量高斯地图。据我们所知,VINGS-Mono是首个能在户外环境运行且支持千米级大场景的单目高斯SLAM方法。

原文摘要 · Abstract (English)

VINGS-Mono is a monocular (inertial) Gaussian Splatting (GS) SLAM framework designed for large scenes. The framework comprises four main components: VIO Front End, 2D Gaussian Map, NVS Loop Closure, and Dynamic Eraser. In the VIO Front End, RGB frames are processed through dense bundle adjustment and uncertainty estimation to extract scene geometry and poses. Based on this output, the mapping module incrementally constructs and maintains a 2D Gaussian map. Key components of the 2D Gaussian Map include a Sample-based Rasterizer, Score Manager, and Pose Refinement, which collectively improve mapping speed and localization accuracy. This enables the SLAM system to handle large-scale urban environments with up to 50 million Gaussian ellipsoids. To ensure global consistency in large-scale scenes, we design a Loop Closure module, which innovatively leverages the Novel View Synthesis (NVS) capabilities of Gaussian Splatting for loop closure detection and correction of the Gaussian map. Additionally, we propose a Dynamic Eraser to address the inevitable presence of dynamic objects in real-world outdoor scenes. Extensive evaluations in indoor and outdoor environments demonstrate that our approach achieves localization performance on par with Visual-Inertial Odometry while surpassing recent GS/NeRF SLAM methods. It also significantly outperforms all existing methods in terms of mapping and rendering quality. Furthermore, we developed a mobile app and verified that our framework can generate high-quality Gaussian maps in real time using only a smartphone camera and a low-frequency IMU sensor. To the best of our knowledge, VINGS-Mono is the first monocular Gaussian SLAM method capable of operating in outdoor environments and supporting kilometer-scale large scenes.

SLAM高斯点云单目建图移动设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。