解决运动模糊导致的定位与建图失效问题,提升真实场景下的3D重建质量。
MBA-SLAM: Motion Blur Aware Gaussian Splatting SLAM
- 基于物理成像模型,联合估计相机运动轨迹与3D场景表示。
- 在含运动模糊的真实和合成数据上均超越现有最先进方法。
- 适合需要高鲁棒性视觉里程计的自动驾驶、低光环境应用。
新兴的3D场景表示方法如神经辐射场(NeRF)和3D高斯点云(3DGS)已在高画质视频输入下展现出出色的同步定位与地图构建(SLAM)能力。然而,现有方法在面对运动模糊图像时表现不佳,这类情况常见于低光照或长曝光条件,常导致相机定位精度和地图重建质量显著下降。为此,本文提出一种密集视觉去模糊SLAM框架(MBA-SLAM),可处理严重运动模糊输入并增强图像去模糊效果。该方法结合高效的运动模糊感知追踪器与基于神经辐射场或高斯点云的映射器,通过准确建模运动模糊图像的物理成像过程,同时学习3D场景表示并估计曝光期间相机的局部轨迹,实现对由相机运动引起的运动模糊的主动补偿。实验表明,MBA-SLAM在多个数据集(包括清晰图像和运动模糊图像)上均优于现有最先进方法,在相机定位与地图重建方面表现更优,展现了方法的通用性与鲁棒性。代码已开源:https://github.com/WU-CVGL/MBA-SLAM。
原文摘要 · Abstract (English)
Emerging 3D scene representations, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have demonstrated their effectiveness in Simultaneous Localization and Mapping (SLAM) for photo-realistic rendering, particularly when using high-quality video sequences as input. However, existing methods struggle with motion-blurred frames, which are common in real-world scenarios like low-light or long-exposure conditions. This often results in a significant reduction in both camera localization accuracy and map reconstruction quality. To address this challenge, we propose a dense visual deblur SLAM pipeline (i.e. MBA-SLAM) to handle severe motion-blurred inputs and enhance image deblurring. Our approach integrates an efficient motion blur-aware tracker with either neural radiance fields or Gaussian Splatting based mapper. By accurately modeling the physical image formation process of motion-blurred images, our method simultaneously learns 3D scene representation and estimates the cameras' local trajectory during exposure time, enabling proactive compensation for motion blur caused by camera movement. In our experiments, we demonstrate that MBA-SLAM surpasses previous state-of-the-art methods in both camera localization and map reconstruction, showcasing superior performance across a range of datasets, including synthetic and real datasets featuring sharp images as well as those affected by motion blur, highlighting the versatility and robustness of our approach. Code is available at https://github.com/WU-CVGL/MBA-SLAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。