用城市模型先验提升3D高斯点云的语义精度,让城市重建更结构化。
GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors

- 基于城市场景的层级语义先验,通过两次射线投射生成精确掩码。
- 在粗略建筑分割上提升15.8 IoU,细粒度语义分割提升14.2 mIoU。
- 适合需要结构化城市重建与语义查询的应用场景。
近期的语义3D高斯点云方法主要依赖2D基础模型,常导致边界模糊且难以支持结构化城市语义。而城市模型如CityGML包含分层组织的语义与建筑几何信息,但无法直接映射到高斯原型。本文提出GS4City,一种融合城市模型先验的层次化语义高斯点云方法。该方法通过两阶段射线投射从LoD 3 CityGML模型中提取对齐图像的可靠掩码,并利用父子关系验证与恢复细粒度立面元素。随后将这些几何引导的掩码与基础模型预测融合,建立场景一致的实例对应关系,并在联合2D身份监督与3D空间正则化下学习每个高斯的紧凑身份编码。在TUM2TWIN和Gold Coast数据集上的实验表明,GS4City能有效将结构化建筑语义融入高斯场景表示,相比现有2D驱动的语义3DGS基线(包括LangSplat和Gaga),在粗略建筑分割上提升最高达15.8 IoU,在细粒度语义分割上提升14.2 mIoU。GS4City实现了结构感知与语义可查询的城市重建。代码已开源:https://github.com/Jinyzzz/GS4City。
原文摘要 · Abstract (English)
Recent semantic 3D Gaussian Splatting (3DGS) methods primarily rely on 2D foundation models, often yielding ambiguous boundaries and limited support for structured urban semantics. While city models such as CityGML encode hierarchically organized semantics together with building geometry, these labels cannot be directly mapped to Gaussian primitives. We present GS4City, a hierarchical semantic Gaussian Splatting method that incorporates city-model priors for urban scene understanding. GS4City derives reliable image-aligned masks from Level of Detail (LoD) 3 CityGML models via two-pass raycasting, explicitly using parent-child relations to validate and recover fine-grained facade elements. It then fuses these geometry-grounded masks with foundation-model predictions to establish scene-consistent instance correspondences, and learns a compact identity encoding for each Gaussian under joint 2D identity supervision and 3D spatial regularization. Experiments on the TUM2TWIN and Gold Coast datasets show that GS4City effectively incorporates structured building semantics into Gaussian scene representations, outperforming existing 2D-driven semantic 3DGS baselines, including LangSplat and Gaga, by up to 15.8 IoU points in coarse building segmentation and 14.2 mIoU points in fine-grained semantic segmentation. By bridging structured city models and photorealistic Gaussian scene representations, GS4City enables semantically queryable and structure-aware urban reconstruction. Code is available at https://github.com/Jinyzzz/GS4City.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。