arXiv:2412.03473cs.CV2024-12被引 8

用语义图分离静态与动态物体,提升城市场景重建精度与效率

UrbanGS: Semantic-Guided Gaussian Splatting for Urban Scene Reconstruction

  • 基于2D语义图区分静态与潜在动态物体,分别处理
  • 静态区域强加全局一致性,动态区域用可学习时间嵌入建模形变
  • 在真实数据集上优于现有方法,尤其在保持静态结构方面表现突出

城市场景重建因几何复杂性和潜在动态物体而困难。基于3D高斯点阵的方法虽表现优异,但多数依赖人工3D标注来建模动态物体,成本过高。部分方法采用4D高斯点阵统一表示全场景,却对静态物体也频繁更新,影响重建质量。为此,我们提出UrbanGS,利用2D语义图和已有动态高斯方法,区分确定静态与潜在动态元素,实现分治处理。对于确定静态区域,强制全局一致性以避免动态高斯意外变化,并引入基于K近邻的正则化提升低纹理地面局部一致性。对于潜在动态物体,通过可学习时间嵌入聚合时序信息,使每个高斯能建模时间上的形变。在真实世界数据集上的大量实验表明,该方法在重建质量和效率上均优于当前最优方法,准确保留静态内容的同时有效捕捉动态元素。

原文摘要 · Abstract (English)

Reconstructing urban scenes is challenging due to their complex geometries and the presence of potentially dynamic objects. 3D Gaussian Splatting (3DGS)-based methods have shown strong performance, but existing approaches often incorporate manual 3D annotations to improve dynamic object modeling, which is impractical due to high labeling costs. Some methods leverage 4D Gaussian Splatting (4DGS) to represent the entire scene, but they treat static and dynamic objects uniformly, leading to unnecessary updates for static elements and ultimately degrading reconstruction quality. To address these issues, we propose UrbanGS, which leverages 2D semantic maps and an existing dynamic Gaussian approach to distinguish static objects from the scene, enabling separate processing of definite static and potentially dynamic elements. Specifically, for definite static regions, we enforce global consistency to prevent unintended changes in dynamic Gaussian and introduce a K-nearest neighbor (KNN)-based regularization to improve local coherence on low-textured ground surfaces. Notably, for potentially dynamic objects, we aggregate temporal information using learnable time embeddings, allowing each Gaussian to model deformations over time. Extensive experiments on real-world datasets demonstrate that our approach outperforms state-of-the-art methods in reconstruction quality and efficiency, accurately preserving static content while capturing dynamic elements.

三维重建高斯点阵语义分割动态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。