解决城市级3D重建中多层级特征孤立问题,提升建筑纹理与几何精度。
HiCo-GS: Hierarchical Context Aggregation and Geometric Consistency for Octree Gaussian Splatting

- 通过层级上下文聚合,实现粗细特征双向信息流动。
- 在真实城市数据集上实现比现有方法更清晰的建筑纹理与更稳定几何结构。
- 适合关注高保真城市3D重建与细节还原的研究者与应用开发者。
基于八叉树的锚点高斯点阵已成为城市尺度新视角合成的可扩展表示方法,其中多层级锚点自适应捕捉从粗略建筑结构到精细建筑细节的场景内容。然而,我们发现现有方法存在根本性局限:跨层级特征孤立,各层级锚点特征独立优化且无层级间通信,导致建筑立面出现颜色漂移、纹理区域过度平滑。本文提出HiCo-GS,一个高保真重建框架,包含两个互补模块:跨层级上下文聚合(CLCA)利用八叉树的空间包含结构,将每层级上下文向量聚合为父-自-子三元组,通过轻量MLP与残差连接融合,使粗层级结构先验向下传递以指导细层级锚点,同时细层级细节统计反向反馈防止过度平滑,计算开销极低;深度-法线几何一致性(DNGC)正则化通过加权一致性损失强制渲染法线与深度推导法线一致,并引入边缘感知平滑损失,配合渐进式预热策略,利用城市几何中普遍存在的平面先验抑制浮动伪影。我们还构建了中国佛塔数据集(China-Pagoda),包含8座古代中国佛塔,每座超过1,200张图像,具有密集装饰雕刻、曲线多层屋檐和重复性细粒度纹理。在Mill19、UrbanScene3D、MatrixCity和China-Pagoda上的大量实验表明,HiCo-GS在真实世界与合成城市基准上均达到领先渲染质量,显著改善几何清晰度。
原文摘要 · Abstract (English)
Octree-based anchor Gaussian Splatting has emerged as a scalable representation for city-scale novel view synthesis, where multi-level anchors adaptively capture scene content from coarse building structures to fine architectural details. However, we identify a fundamental limitation in existing methods: cross-level feature isolation, where each level's anchor features are optimized independently with no inter-level communication, causing color drift on building facades and over-smoothing in textured regions. We present HiCo-GS, a high-fidelity reconstruction framework with two complementary modules. Cross-Level Context Aggregation (CLCA) enables bidirectional hierarchical prior injection by leveraging the octree's spatial containment structure to aggregate per-level context vectors into parent-self-child triplets, fused via a lightweight MLP with residual connection. Coarse-level structural priors flow down to inform fine-level anchors, while fine-level detail statistics feed back to prevent over-smoothing, at negligible computational overhead. Depth-Normal Geometric Consistency (DNGC) regularization enforces agreement between rendered normals and depth-derived normals through an alpha-weighted consistency loss, complemented by edge-aware smoothness losses with progressive warmup that exploit the strong planar priors ubiquitous in urban geometry to suppress floating artifacts. We further introduce the China-Pagoda dataset comprising 8 ancient Chinese pagodas with over 1,200 images each, featuring dense ornamental carvings, curved multi-layer eaves, and repetitive fine-grained textures. Extensive experiments on Mill19, UrbanScene3D, MatrixCity, and China-Pagoda demonstrate that HiCo-GS achieves state-of-the-art rendering quality and substantially cleaner geometry across real-world and synthetic urban benchmarks.Code: https://github.com/WZ-CS/HiCo-GS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。