用3D高斯点云重建光泽物体的几何与材质,效果更真实。
GlossyGS: Inverse Rendering of Glossy Objects with 3D Gaussian Splatting
- 通过微面几何分割先验减少反向渲染歧义
- 结合法线图预过滤,更准确模拟反射表面
- 适合需要高保真光泽物体重建的研究者
从姿态图像中重建物体是计算机图形学与计算机视觉中的关键且复杂任务。尽管基于NeRF的神经重建方法表现出色,但计算耗时。近期采用3D高斯点云(3D-GS)的方法实现了快速有效的结果。然而,这些方法在生成光泽物体的真实几何与材质方面仍存在困难,根源在于反向渲染的固有歧义。为此,我们提出GlossyGS,一种基于3D-GS的创新反向渲染框架,通过引入材质先验精确重建光泽物体的几何与材质。核心思想是使用微面几何分割先验,以降低内在歧义并改善几何与材质的解耦。此外,引入法线图预过滤策略,更准确地模拟反射表面的法线分布。这些策略整合到混合几何与材质表示中,同时采用显式与隐式方法描述光泽物体。通过定量分析与定性可视化,证明该方法能有效重建高保真几何与材质,性能优于现有最优方法。
原文摘要 · Abstract (English)
Reconstructing objects from posed images is a crucial and complex task in computer graphics and computer vision. While NeRF-based neural reconstruction methods have exhibited impressive reconstruction ability, they tend to be time-comsuming. Recent strategies have adopted 3D Gaussian Splatting (3D-GS) for inverse rendering, which have led to quick and effective outcomes. However, these techniques generally have difficulty in producing believable geometries and materials for glossy objects, a challenge that stems from the inherent ambiguities of inverse rendering. To address this, we introduce GlossyGS, an innovative 3D-GS-based inverse rendering framework that aims to precisely reconstruct the geometry and materials of glossy objects by integrating material priors. The key idea is the use of micro-facet geometry segmentation prior, which helps to reduce the intrinsic ambiguities and improve the decomposition of geometries and materials. Additionally, we introduce a normal map prefiltering strategy to more accurately simulate the normal distribution of reflective surfaces. These strategies are integrated into a hybrid geometry and material representation that employs both explicit and implicit methods to depict glossy objects. We demonstrate through quantitative analysis and qualitative visualization that the proposed method is effective to reconstruct high-fidelity geometries and materials of glossy objects, and performs favorably against state-of-the-arts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。