提升动态场景下4D重建精度,通过不确定性重加权实现更鲁棒的SLAM
RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction
- 引入时间因素与动态感知,改进像素级不确定性建模
- 在含移动物体和模糊图像的场景中,轨迹误差降低37.2%
- 适合需要高精度4D重建的自动驾驶与机器人导航应用
将3D高斯点阵与同时定位与地图构建(SLAM)结合,可实现运动中的连续3D环境重建。然而,现有方法在动态环境中表现不佳,尤其移动物体干扰3D重建并影响可靠追踪。4D重建,特别是4D高斯点阵,为解决该问题提供了新方向,但其在4D感知SLAM中的潜力尚未充分探索。为此,本文提出鲁棒高效的框架RU4D-SLAM,通过在空间3D表示中融入时间因素,结合对场景变化的不确定性感知、模糊图像合成与动态场景重建。我们通过引入运动模糊渲染增强动态场景表征,并扩展原本用于静态场景的逐像素不确定性建模以处理模糊图像。进一步提出语义引导的不确定性重加权机制,以及可学习的不透明度权重,支持自适应4D映射。在标准基准上的大量实验表明,本方法在轨迹精度和4D场景重建方面显著优于现有最优方法,尤其在含移动物体和低质量输入的动态环境中表现突出。
原文摘要 · Abstract (English)
Combining 3D Gaussian splatting with Simultaneous Localization and Mapping (SLAM) has gained popularity as it enables continuous 3D environment reconstruction during motion. However, existing methods struggle in dynamic environments, particularly moving objects complicate 3D reconstruction and, in turn, hinder reliable tracking. The emergence of 4D reconstruction, especially 4D Gaussian splatting, offers a promising direction for addressing these challenges, yet its potential for 4D-aware SLAM remains largely underexplored. Along this direction, we propose a robust and efficient framework, namely Reweighting Uncertainty in Gaussian Splatting SLAM (RU4D-SLAM) for 4D scene reconstruction, that introduces temporal factors into spatial 3D representation while incorporating uncertainty-aware perception of scene changes, blurred image synthesis, and dynamic scene reconstruction. We enhance dynamic scene representation by integrating motion blur rendering, and improve uncertainty-aware tracking by extending per-pixel uncertainty modeling, which is originally designed for static scenarios, to handle blurred images. Furthermore, we propose a semantic-guided reweighting mechanism for per-pixel uncertainty estimation in dynamic scenes, and introduce a learnable opacity weight to support adaptive 4D mapping. Extensive experiments on standard benchmarks demonstrate that our method substantially outperforms state-of-the-art approaches in both trajectory accuracy and 4D scene reconstruction, particularly in dynamic environments with moving objects and low-quality inputs. Code available: https://ru4d-slam.github.io
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。