arXiv:2506.14229cs.CVcs.AI2025-06被引 7

分块优化+重要性剪枝,实现高分辨率3D重建的内存节省

HRGS: Hierarchical Gaussian Splatting for Memory-Efficient High-Resolution 3D Reconstruction

  • 分层块优化:先粗后精,用低分辨率生成全局先验再局部细化
  • 在三个基准上达到顶尖的新视角合成与表面重建效果
  • 适合资源受限下追求高质量3D重建的研究者和开发者

3D高斯点阵(3DGS)在实时3D场景重建中取得显著进展,但在高分辨率场景下面临内存扩展性问题。为此,我们提出分层高斯点阵(HRGS),一种内存高效的框架,采用分层块级优化。首先,从低分辨率数据生成全局粗粒度高斯表示;随后,将场景划分为多个块,利用高分辨率数据对每个块进行细化。划分包含两步:高斯划分,将不规则场景归一化至有界立方空间,并用均匀网格分配任务;训练数据划分,仅保留每个块相关的观测数据。通过粗粒度高斯先验引导块间细化,确保相邻块间的高斯融合无缝。为降低计算负担,引入重要性驱动的高斯剪枝(IDGP),计算每个高斯的重要性得分并移除贡献最小者,加速收敛并减少内存占用。此外,引入预训练模型的法向先验以提升表面重建质量。实验在三个基准上验证,HRGS在高分辨率新视角合成(NVS)与表面重建任务中达到当前最优性能。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has made significant strides in real-time 3D scene reconstruction, but faces memory scalability issues in high-resolution scenarios. To address this, we propose Hierarchical Gaussian Splatting (HRGS), a memory-efficient framework with hierarchical block-level optimization. First, we generate a global, coarse Gaussian representation from low-resolution data. Then, we partition the scene into multiple blocks, refining each block with high-resolution data. The partitioning involves two steps: Gaussian partitioning, where irregular scenes are normalized into a bounded cubic space with a uniform grid for task distribution, and training data partitioning, where only relevant observations are retained for each block. By guiding block refinement with the coarse Gaussian prior, we ensure seamless Gaussian fusion across adjacent blocks. To reduce computational demands, we introduce Importance-Driven Gaussian Pruning (IDGP), which computes importance scores for each Gaussian and removes those with minimal contribution, speeding up convergence and reducing memory usage. Additionally, we incorporate normal priors from a pretrained model to enhance surface reconstruction quality. Our method enables high-quality, high-resolution 3D scene reconstruction even under memory constraints. Extensive experiments on three benchmarks show that HRGS achieves state-of-the-art performance in high-resolution novel view synthesis (NVS) and surface reconstruction tasks.

3D重建高斯点阵内存优化分块策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。