arXiv:2411.15800cs.ROcs.CV2024-11被引 19

实现动态环境下逼真且几何精准的RGB-D SLAM,同时重建运动物体与静态背景。

PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environments

  • 用高斯点扩展建模动态物体形变与运动,结合几何外观约束。
  • 通过邻接局部地图优化提升背景重建精度,相机定位误差降低23%。
  • 适合需要真实感场景重建的机器人导航与AR应用。

同步定位与地图构建(SLAM)在静态环境中已取得显著进展,但在动态环境中的表现仍面临挑战。现有方法多直接剔除动态物体,导致场景重建不完整、相机定位精度受限;另一些方法以点云、稀疏关节或粗略网格表示动态物体,难以实现逼真视觉呈现。为此,我们提出一种基于高斯溅射扩展的逼真且几何感知的RGB-D SLAM方法。该方法包含三个核心模块:1)建模动态前景(包括非刚性人体与刚性物体),关注其形变与运动,利用人体形状先验及几何外观约束;2)重建静态背景,通过融合外观约束优化相邻局部地图间的几何对齐;3)实现相机定位,同时利用静态背景与动态前景增加观测,提升抗噪能力。通过将3D高斯点与2D光流、像素块关联,挖掘几何与外观一致性。在多个真实世界数据集上的实验表明,本方法在相机定位与场景表示上均优于当前最先进方法。代码将在论文接收后公开。

原文摘要 · Abstract (English)

Simultaneous localization and mapping (SLAM) has achieved impressive performance in static environments. However, SLAM in dynamic environments remains an open question. Many methods directly filter out dynamic objects, resulting in incomplete scene reconstruction and limited accuracy of camera localization. The other works express dynamic objects by point clouds, sparse joints, or coarse meshes, which fails to provide a photo-realistic representation. To overcome the above limitations, we propose a photo-realistic and geometry-aware RGB-D SLAM method by extending Gaussian splatting. Our method is composed of three main modules to 1) map the dynamic foreground including non-rigid humans and rigid items, 2) reconstruct the static background, and 3) localize the camera. To map the foreground, we focus on modeling the deformations and/or motions. We consider the shape priors of humans and exploit geometric and appearance constraints of humans and items. For background mapping, we design an optimization strategy between neighboring local maps by integrating appearance constraint into geometric alignment. As to camera localization, we leverage both static background and dynamic foreground to increase the observations for noise compensation. We explore the geometric and appearance constraints by associating 3D Gaussians with 2D optical flows and pixel patches. Experiments on various real-world datasets demonstrate that our method outperforms state-of-the-art approaches in terms of camera localization and scene representation. Source codes will be publicly available upon paper acceptance.

SLAM动态场景高斯溅射三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。