arXiv:2502.14129cs.CV2025-02被引 3

用各向异性球谐高斯提升高光表面重建效率,兼顾真实感与实时渲染。

GlossGau: Efficient Inverse Rendering for Glossy Surface with Anisotropic Spherical Gaussian

  • 用各向异性球谐高斯建模微表面反射,显式分解法线与材质参数。
  • 在保持3D-GS训练速度的前提下,实现比现有方法更快的优化时间。
  • 适合需要高效重建高光物体的场景,如工业设计、虚拟拍摄等。

从校准照片中重建3D物体是计算机图形学与视觉领域的基础挑战。尽管基于神经辐射场(NeRF)的方法表现优异,但其计算成本仍较高。近期,3D高斯点云(3D-GS)显著提升了训练效率并实现了实时逼真渲染。然而,由于球谐函数(SH)对高频信息表示能力有限,3D-GS难以重建高光表面。虽有研究通过逆渲染增强其镜面表现力,但往往牺牲训练与渲染效率,削弱了高斯点云的优势。本文提出GlossGau,一种高效逆渲染框架,在保持与原版3D-GS相当的训练和渲染速度的同时,成功重建带有高光特性的场景。我们显式建模表面法线、双向反射分布函数(BRDF)参数以及入射光,并采用各向异性球谐高斯(ASG)在微表面模型下逼近每高斯点的法线分布函数。以2D高斯点云(2D-GS)为基础,并施加正则化以有效缓解法线估计难题。实验表明,GlossGau在包含高光表面的数据集上达到竞争性或更优的重建效果,且优化时间显著少于先前基于GS的高光表面方法。

原文摘要 · Abstract (English)

The reconstruction of 3D objects from calibrated photographs represents a fundamental yet intricate challenge in the domains of computer graphics and vision. Although neural reconstruction approaches based on Neural Radiance Fields (NeRF) have shown remarkable capabilities, their processing costs remain substantial. Recently, the advent of 3D Gaussian Splatting (3D-GS) largely improves the training efficiency and facilitates to generate realistic rendering in real-time. However, due to the limited ability of Spherical Harmonics (SH) to represent high-frequency information, 3D-GS falls short in reconstructing glossy objects. Researchers have turned to enhance the specular expressiveness of 3D-GS through inverse rendering. Yet these methods often struggle to maintain the training and rendering efficiency, undermining the benefits of Gaussian Splatting techniques. In this paper, we introduce GlossGau, an efficient inverse rendering framework that reconstructs scenes with glossy surfaces while maintaining training and rendering speeds comparable to vanilla 3D-GS. Specifically, we explicitly model the surface normals, Bidirectional Reflectance Distribution Function (BRDF) parameters, as well as incident lights and use Anisotropic Spherical Gaussian (ASG) to approximate the per-Gaussian Normal Distribution Function under the microfacet model. We utilize 2D Gaussian Splatting (2D-GS) as foundational primitives and apply regularization to significantly alleviate the normal estimation challenge encountered in related works. Experiments demonstrate that GlossGau achieves competitive or superior reconstruction on datasets with glossy surfaces. Compared with previous GS-based works that address the specular surface, our optimization time is considerably less.

3D重建高光表面高斯点云逆渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。