arXiv:2409.10041cs.CV2024-09被引 4

用小波动态估计光照,让动态城市场景重建更真实。

DENSER: 3D Gaussians Splatting for Scene Reconstruction of Dynamic Urban Environments

  • 用小波动态估算球谐光照基,提升时空一致性
  • 在KITTI数据集上显著优于现有方法,细节还原更精准
  • 适合需要高精度动态场景重建的研究与应用

本文提出DENSER,一种基于3D高斯点云的高效动态城市环境重建方法。尽管基于神经辐射场(NeRF)和显式3D高斯溅射(3DGS)的方法在复杂动态场景中已取得良好效果,但对前景物体动态外观的建模仍具挑战,尤其难以捕捉远距离动态物体的细微变化。为此,DENSER引入一种新方法,不直接使用球谐函数(SH)表示动态物体外观,而是通过小波动态估计SH基,显著提升物体在时空维度上的外观表征能力。此外,通过多帧点云稠密化增强物体形状表示,加速模型训练收敛。在KITTI数据集上的大量实验表明,该方法显著优于当前最先进方法。代码与模型将公开于https://github.com/sntubix/denser。

原文摘要 · Abstract (English)

This paper presents DENSER, an efficient and effective approach leveraging 3D Gaussian splatting (3DGS) for the reconstruction of dynamic urban environments. While several methods for photorealistic scene representations, both implicitly using neural radiance fields (NeRF) and explicitly using 3DGS have shown promising results in scene reconstruction of relatively complex dynamic scenes, modeling the dynamic appearance of foreground objects tend to be challenging, limiting the applicability of these methods to capture subtleties and details of the scenes, especially far dynamic objects. To this end, we propose DENSER, a framework that significantly enhances the representation of dynamic objects and accurately models the appearance of dynamic objects in the driving scene. Instead of directly using Spherical Harmonics (SH) to model the appearance of dynamic objects, we introduce and integrate a new method aiming at dynamically estimating SH bases using wavelets, resulting in better representation of dynamic objects appearance in both space and time. Besides object appearance, DENSER enhances object shape representation through densification of its point cloud across multiple scene frames, resulting in faster convergence of model training. Extensive evaluations on KITTI dataset show that the proposed approach significantly outperforms state-of-the-art methods by a wide margin. Source codes and models will be uploaded to this repository https://github.com/sntubix/denser

3D重建动态场景高斯溅射小波分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。