arXiv:2412.16809cs.CV2024-12被引 6

提出几何纹理感知的点云优化方法,提升3D高斯泼溅的细节还原与真实感。

GeoTexDensifier: Geometry-Texture-Aware Densification for High-Quality Photorealistic 3D Gaussian Splatting

  • 根据纹理丰富度自动加密点云,低纹理区保持稀疏以避免噪声
  • 结合深度与法线先验过滤远离真实表面的噪声点,提升重建精度
  • 特别适用于弱纹理或视角不足场景,适合高质量3D建模应用

3D高斯泼溅(3DGS)因其逼真的渲染效果和高效性,在3D导航、虚拟现实和3D仿真等领域广受关注。高质量重建依赖于足够数量且分布合理的高斯点,以贴合真实几何结构与纹理细节,但这一问题仍具挑战。本文提出GeoTexDensifier,一种几何-纹理感知的点云优化策略,可生成更符合场景几何结构与纹理丰富的高斯点。具体而言,该框架采用辅助纹理感知加密机制,在纹理丰富的区域生成更密集的点云,同时在低纹理区域保持稀疏,以维护点云质量;此外,通过深度与法线先验引导分割采样,并引入深度比变化验证机制,滤除初始位置远离实际表面的噪声点。借助相对单目深度先验,该几何感知验证有效降低了散乱高斯点对最终渲染质量的影响,尤其在纹理弱或训练视图不足的区域表现优异。纹理感知加密与几何感知分割策略协同作用,显著提升了3DGS模型的保真度。我们在多个数据集上进行了实验,定量与定性评估表明,相比现有最先进方法,本方法在新视角合成任务中生成了更具真实感的3DGS模型。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has recently attracted wide attentions in various areas such as 3D navigation, Virtual Reality (VR) and 3D simulation, due to its photorealistic and efficient rendering performance. High-quality reconstrution of 3DGS relies on sufficient splats and a reasonable distribution of these splats to fit real geometric surface and texture details, which turns out to be a challenging problem. We present GeoTexDensifier, a novel geometry-texture-aware densification strategy to reconstruct high-quality Gaussian splats which better comply with the geometric structure and texture richness of the scene. Specifically, our GeoTexDensifier framework carries out an auxiliary texture-aware densification method to produce a denser distribution of splats in fully textured areas, while keeping sparsity in low-texture regions to maintain the quality of Gaussian point cloud. Meanwhile, a geometry-aware splitting strategy takes depth and normal priors to guide the splitting sampling and filter out the noisy splats whose initial positions are far from the actual geometric surfaces they aim to fit, under a Validation of Depth Ratio Change checking. With the help of relative monocular depth prior, such geometry-aware validation can effectively reduce the influence of scattered Gaussians to the final rendering quality, especially in regions with weak textures or without sufficient training views. The texture-aware densification and geometry-aware splitting strategies are fully combined to obtain a set of high-quality Gaussian splats. We experiment our GeoTexDensifier framework on various datasets and compare our Novel View Synthesis results to other state-of-the-art 3DGS approaches, with detailed quantitative and qualitative evaluations to demonstrate the effectiveness of our method in producing more photorealistic 3DGS models.

3D高斯泼溅点云优化真实感渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。