arXiv:2409.12774cs.CVcs.AI2024-09被引 6

用分块+强化高斯场提升大场景3D重建质量与效率

GaRField++: Reinforced Gaussian Radiance Fields for Large-Scale 3D Scene Reconstruction

论文配图:GaRField++: Reinforced Gaussian Radiance Fields for Large-Scale 3D Scene Reconstruction
图 1 · 摘自论文原文
  • 分块处理大场景,通过可见性选相机和渐进点云扩展提升可扩展性
  • 在三个基准数据集上重建质量优于当前最优方法,细节更清晰
  • 适合需要高质量大场景重建的无人机/自动驾驶应用

本文提出一种基于3D高斯泼溅(3DGS)的大规模场景重建新框架,旨在解决现有方法在可扩展性和精度上的挑战。为应对可扩展性问题,将大场景划分为多个单元,通过基于可见性的相机选择和渐进式点云扩展来关联各单元的候选点云与相机视角。为增强渲染质量,相比原始3DGS引入三项改进:基于射线-高斯相交策略与新型高斯密度控制以提升学习效率;基于ConvKAN网络的外观解耦模块以缓解大规模场景中光照不均问题;以及融合颜色损失、深度畸变损失和法向一致性损失的优化损失函数。最后执行无缝拼接流程,合并各单元的高斯辐射场,实现跨单元的新视角合成。在Mill19、Urban3D和MatrixCity数据集上的评估表明,该方法持续生成比现有最先进方法更高保真度的渲染结果。进一步通过自采集的商用无人机视频片段验证了方法的泛化能力。

原文摘要 · Abstract (English)

This paper proposes a novel framework for large-scale scene reconstruction based on 3D Gaussian splatting (3DGS) and aims to address the scalability and accuracy challenges faced by existing methods. For tackling the scalability issue, we split the large scene into multiple cells, and the candidate point-cloud and camera views of each cell are correlated through a visibility-based camera selection and a progressive point-cloud extension. To reinforce the rendering quality, three highlighted improvements are made in comparison with vanilla 3DGS, which are a strategy of the ray-Gaussian intersection and the novel Gaussians density control for learning efficiency, an appearance decoupling module based on ConvKAN network to solve uneven lighting conditions in large-scale scenes, and a refined final loss with the color loss, the depth distortion loss, and the normal consistency loss. Finally, the seamless stitching procedure is executed to merge the individual Gaussian radiance field for novel view synthesis across different cells. Evaluation of Mill19, Urban3D, and MatrixCity datasets shows that our method consistently generates more high-fidelity rendering results than state-of-the-art methods of large-scale scene reconstruction. We further validate the generalizability of the proposed approach by rendering on self-collected video clips recorded by a commercial drone.

3D重建高斯泼溅大场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。