将法向量融入3D高斯渲染,提升表面精度与视觉质量。
Normal-GS: 3D Gaussian Splatting with Normal-Involved Rendering
- 用物理光照方程建模法向量与光照交互,改进渲染机制。
- 在保持实时性能下,表面法向精度显著提升,视觉质量接近顶尖水平。
- 适合关注高保真三维重建与真实感渲染的研究者。
渲染与重建是计算机视觉与图形学中的长期课题。实现高质量渲染与精确几何估计仍是挑战。近期3D高斯溅射(3DGS)技术实现了实时速度下的高保真新视角合成。然而,3D高斯原语的噪声与离散特性限制了表面估计的准确性。此前尝试正则化3D高斯法向量的方法常因法向量与渲染流程的根本脱节而损害渲染质量。为此,我们提出Normal-GS,将法向量整合进3DGS渲染管线。核心思想是利用基于物理的渲染方程建模法向量与入射光照的交互。我们将表面颜色重新参数化为法向量与设计的集成方向光照向量(IDIV)的乘积。为优化内存并简化优化,采用基于锚点的3DGS隐式编码局部共享的IDIV。此外,Normal-GS利用优化后的法向量与集成方向编码(IDE),准确建模镜面反射效果,同时提升渲染质量与表面法向精度。大量实验表明,Normal-GS在保持实时性能的同时,达到接近顶尖的视觉质量,并获得高精度表面法向。
原文摘要 · Abstract (English)
Rendering and reconstruction are long-standing topics in computer vision and graphics. Achieving both high rendering quality and accurate geometry is a challenge. Recent advancements in 3D Gaussian Splatting (3DGS) have enabled high-fidelity novel view synthesis at real-time speeds. However, the noisy and discrete nature of 3D Gaussian primitives hinders accurate surface estimation. Previous attempts to regularize 3D Gaussian normals often degrade rendering quality due to the fundamental disconnect between normal vectors and the rendering pipeline in 3DGS-based methods. Therefore, we introduce Normal-GS, a novel approach that integrates normal vectors into the 3DGS rendering pipeline. The core idea is to model the interaction between normals and incident lighting using the physically-based rendering equation. Our approach re-parameterizes surface colors as the product of normals and a designed Integrated Directional Illumination Vector (IDIV). To optimize memory usage and simplify optimization, we employ an anchor-based 3DGS to implicitly encode locally-shared IDIVs. Additionally, Normal-GS leverages optimized normals and Integrated Directional Encoding (IDE) to accurately model specular effects, enhancing both rendering quality and surface normal precision. Extensive experiments demonstrate that Normal-GS achieves near state-of-the-art visual quality while obtaining accurate surface normals and preserving real-time rendering performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。