arXiv:2501.01677cs.CV2025-01被引 10

用语义分组实现高精度城市建筑三维重建,无需降分辨率。

PG-SAG: Parallel Gaussian Splatting for Fine-Grained Large-Scale Urban Buildings Reconstruction via Semantic-Aware Grouping

  • 基于语义分割分组,按可见性划分区域并行优化高斯核
  • 保留原始图像分辨率,边缘处重定义法向量损失提升精度
  • 自适应负载均衡损失减少计算等待,适合大规模城市建模

3D高斯泼溅(3DGS)已成为实时新视角合成的变革性方法。现有方法通过空间分区策略降低显存占用和优化时间成本,以应对大规模场景。本文提出并行高斯泼溅方法PG-SAG,充分利用语义信息进行分区与高斯核优化,实现在不降采样原始图像分辨率的前提下,对大规模城市建筑进行细粒度表面重建。首先,采用跨模态模型语言-分割任意物体(Language Segment Anything)生成建筑掩码;随后,根据注册图像间的可见性将掩码区域分组为子区域;对这些子区域中的高斯核进行掩码像素并行优化。此外,重新设计边缘处的法向量损失以缓解边缘区域法向量模糊问题。最后,引入梯度约束的负载均衡损失,根据场景复杂度动态调整分配,有效减少像素并行渲染阶段的线程等待时间及重建损失。在多个城市数据集上的大量实验表明,相比多种先进3DGS方法,本方法在建筑表面重建上表现更优。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has emerged as a transformative method in the field of real-time novel synthesis. Based on 3DGS, recent advancements cope with large-scale scenes via spatial-based partition strategy to reduce video memory and optimization time costs. In this work, we introduce a parallel Gaussian splatting method, termed PG-SAG, which fully exploits semantic cues for both partitioning and Gaussian kernel optimization, enabling fine-grained building surface reconstruction of large-scale urban areas without downsampling the original image resolution. First, the Cross-modal model - Language Segment Anything is leveraged to segment building masks. Then, the segmented building regions is grouped into sub-regions according to the visibility check across registered images. The Gaussian kernels for these sub-regions are optimized in parallel with masked pixels. In addition, the normal loss is re-formulated for the detected edges of masks to alleviate the ambiguities in normal vectors on edges. Finally, to improve the optimization of 3D Gaussians, we introduce a gradient-constrained balance-load loss that accounts for the complexity of the corresponding scenes, effectively minimizing the thread waiting time in the pixel-parallel rendering stage as well as the reconstruction lost. Extensive experiments are tested on various urban datasets, the results demonstrated the superior performance of our PG-SAG on building surface reconstruction, compared to several state-of-the-art 3DGS-based methods. Project Web:https://github.com/TFWang-9527/PG-SAG.

3D重建高斯泼溅语义分组城市建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。