解决动态城市场景中3D高斯点云重建缺失问题,提升视觉一致性。
VAD-GS: Visibility-Aware Densification for 3D Gaussian Splatting in Dynamic Urban Scenes
- 基于体素可见性分析识别不可靠几何结构
- 通过多视角立体重建恢复缺失区域的点云
- 适合处理无完整观测的动态城市场景建模
3D高斯溅射(3DGS)在生成高保真新视角方面表现优异,但其效果高度依赖初始点云质量。在无界动态城市环境中,由于观测锥体重叠不足,常导致点云覆盖不均。使用部分初始化点云训练时,相机射线可能无法与有效表面相交,引发错误梯度传播至被遮挡或不可见的几何体。现有加密策略仅复制和分裂已有高斯体,无法从缺失结构中重建几何。为此,我们提出VAD-GS,一种专为复杂城市场景几何恢复设计的3DGS框架。该方法通过体素级可见性推理识别不可靠结构,采用多样性感知视图选择获取信息丰富视角,并借助多视角立体重建恢复缺失几何。此设计使新高斯体在缺乏初始点的区域也能基于可靠几何先验生成。在Waymo和nuScenes数据集上的实验表明,VAD-GS优于当前最优3DGS方法,显著提升了静态与动态物体的重建质量。
原文摘要 · Abstract (English)
3D Gaussian splatting (3DGS) has demonstrated impressive performance in synthesizing high-fidelity novel views. Nonetheless, its effectiveness critically depends on the quality of the initialized point cloud. Specifically, achieving uniform and complete point coverage over the underlying scene structure requires overlapping observation frustums, an assumption that is often violated in unbounded, dynamic urban environments. Training Gaussian models with partially initialized point clouds often leads to distortions and artifacts, as camera rays may fail to intersect valid surfaces, resulting in incorrect gradient propagation to Gaussian primitives associated with occluded or invisible geometry. Additionally, existing densification strategies simply clone and split Gaussian primitives from existing ones, incapable of reconstructing geometry from missing structures. To address these limitations, we propose VAD-GS, a 3DGS framework tailored for geometry recovery in challenging urban scenes. Our method identifies unreliable geometry structures via voxel-based visibility reasoning, selects informative supporting views through diversity-aware view selection, and recovers missing structures via multi-view stereo reconstruction. This design enables the generation of new Gaussian primitives guided by reliable geometric priors, even in regions lacking initial points. Extensive experiments on the Waymo and nuScenes datasets demonstrate that VAD-GS outperforms state-of-the-art 3DGS approaches and significantly improves the quality of reconstructed geometry for both static and dynamic objects. Our project webpage is at mias.group/VAD-GS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。