arXiv:2411.00771cs.CV2024-11ICLR被引 66

提升大规模场景3D重建精度与效率,解决模糊与内存爆炸问题

CityGaussianV2: Efficient and Geometrically Accurate Reconstruction for Large-Scale Scenes

论文配图:CityGaussianV2: Efficient and Geometrically Accurate Reconstruction for Large-Scale Scenes
图 1 · 摘自论文原文
  • 分梯度稀释+深度回归,消除模糊伪影并加速收敛
  • 引入伸长滤波器,使高斯点数增长可控,支持大场景扩展
  • 实现训练速度提升25%、内存降低50%、压缩比达10倍

最近,3D高斯泼溅(3DGS)在辐射场重建中取得突破,实现了高效且高质量的新视角合成。然而,在大规模复杂场景中精确表示表面仍面临挑战,主要源于3DGS的非结构化特性。本文提出CityGaussianV2,一种面向大规模场景重建的新方法,解决了几何精度与效率的关键难题。基于2D高斯泼溅(2DGS)的强泛化能力,我们改进其收敛性与可扩展性:采用基于分解梯度的稀释策略与深度回归技术,消除模糊伪影并加快收敛;为应对2DGS退化导致的高斯点数量激增,设计伸长滤波器进行抑制;同时优化城市重建流程以支持并行训练,实现最高10倍压缩率,训练时间至少节省25%,内存占用减少50%。我们还建立了大规模场景下的标准几何基准。实验表明,该方法在视觉质量、几何精度、存储与训练成本间取得良好平衡。

原文摘要 · Abstract (English)

Recently, 3D Gaussian Splatting (3DGS) has revolutionized radiance field reconstruction, manifesting efficient and high-fidelity novel view synthesis. However, accurately representing surfaces, especially in large and complex scenarios, remains a significant challenge due to the unstructured nature of 3DGS. In this paper, we present CityGaussianV2, a novel approach for large-scale scene reconstruction that addresses critical challenges related to geometric accuracy and efficiency. Building on the favorable generalization capabilities of 2D Gaussian Splatting (2DGS), we address its convergence and scalability issues. Specifically, we implement a decomposed-gradient-based densification and depth regression technique to eliminate blurry artifacts and accelerate convergence. To scale up, we introduce an elongation filter that mitigates Gaussian count explosion caused by 2DGS degeneration. Furthermore, we optimize the CityGaussian pipeline for parallel training, achieving up to 10$\times$ compression, at least 25% savings in training time, and a 50% decrease in memory usage. We also established standard geometry benchmarks under large-scale scenes. Experimental results demonstrate that our method strikes a promising balance between visual quality, geometric accuracy, as well as storage and training costs. The project page is available at https://dekuliutesla.github.io/CityGaussianV2/.

3D重建高斯泼溅大规模场景效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。