提出4D动态高斯溅射方案,实现动态场景中精准建图与跟踪。
D$^2$GSLAM: 4D Dynamic Gaussian Splatting SLAM
- 用几何提示分离静态与动态区域,生成粗略运动掩码。
- 融合静态3D与动态4D高斯表示,支持状态变化建模。
- 通过运动一致性损失提升动态物体建模精度,适合自动驾驶等场景。
近期密集同步定位与建图(SLAM)在静态环境表现优异,但在动态环境中仍具挑战。多数方法直接移除动态物体,仅重建静态场景,忽略其运动信息。本文提出D²GSLAM,一种基于高斯表示的新型动态SLAM系统,可同时实现高精度动态重建与鲁棒相机跟踪。系统包含四部分:(i) 提出几何提示动态分离方法,利用高斯表示的几何一致性与场景结构获得粗略动态区域,作为提示引导精细掩码优化;(ii) 引入动态-静态复合表示,将静态3D高斯与动态4D高斯结合,支持物体在静态与动态状态间转换的联合建模与优化;(iii) 采用渐进式位姿精化策略,融合多视角静态几何一致性与动态物体运动信息,实现精准跟踪;(iv) 设计运动一致性损失,利用物体运动的时间连续性提升动态建模精度。D²GSLAM在动态场景下表现出更优的建图与跟踪精度,并具备精确动态建模能力。
原文摘要 · Abstract (English)
Recent advances in Dense Simultaneous Localization and Mapping (SLAM) have demonstrated remarkable performance in static environments. However, dense SLAM in dynamic environments remains challenging. Most methods directly remove dynamic objects and focus solely on static scene reconstruction, which ignores the motion information contained in these dynamic objects. In this paper, we present D$^2$GSLAM, a novel dynamic SLAM system utilizing Gaussian representation, which simultaneously performs accurate dynamic reconstruction and robust tracking within dynamic environments. Our system is composed of four key components: (i) We propose a geometric-prompt dynamic separation method to distinguish between static and dynamic elements of the scene. This approach leverages the geometric consistency of Gaussian representation and scene geometry to obtain coarse dynamic regions. The regions then serve as prompts to guide the refinement of the coarse mask for achieving accurate motion mask. (ii) To facilitate accurate and efficient mapping of the dynamic scene, we introduce dynamic-static composite representation that integrates static 3D Gaussians with dynamic 4D Gaussians. This representation allows for modeling the transitions between static and dynamic states of objects in the scene for composite mapping and optimization. (iii) We employ a progressive pose refinement strategy that leverages both the multi-view consistency of static scene geometry and motion information from dynamic objects to achieve accurate camera tracking. (iv) We introduce a motion consistency loss, which leverages the temporal continuity in object motions for accurate dynamic modeling. Our D$^2$GSLAM demonstrates superior performance on dynamic scenes in terms of mapping and tracking accuracy, while also showing capability in accurate dynamic modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。