用路径追踪分解全局光照,实现真实感逆渲染与自由调光。
GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Rendering
- 通过延迟着色获取场景几何材质,再轻量路径追踪计算间接光照。
- 在任意光源下生成更真实的间接光效果,提升视角合成与调光质量。
- 适合做高保真3D重建和可调控光照的视觉生成任务。
我们提出GI-GS,一种基于3D高斯点云(3DGS)与延迟着色的新型逆渲染框架,实现照片级真实感新视角合成与调光。在逆渲染中,准确建模物体的着色过程对高保真结果至关重要,需引入全局光照以捕捉经多次散射后到达物体的间接光。现有3DGS方法将间接光建模为可学习的光照体积或高斯属性,用烘焙遮蔽表示阴影,但难以精确模拟光与物体间的复杂物理交互,导致调光时无法生成真实间接光。为此,我们提出使用高效路径追踪结合延迟着色计算间接光。首先渲染出包含场景几何与材质信息的G-buffer;然后仅对直接光进行基于物理的渲染(PBR);利用G-buffer及先前渲染结果,通过轻量路径追踪计算间接光。该方法可在任意光照条件下有效建模间接光,从而实现更优的新视角合成与竞争力调光。定量与定性结果显示,GI-GS在渲染质量和效率上均优于现有基线方法。
原文摘要 · Abstract (English)
We present GI-GS, a novel inverse rendering framework that leverages 3D Gaussian Splatting (3DGS) and deferred shading to achieve photo-realistic novel view synthesis and relighting. In inverse rendering, accurately modeling the shading processes of objects is essential for achieving high-fidelity results. Therefore, it is critical to incorporate global illumination to account for indirect lighting that reaches an object after multiple bounces across the scene. Previous 3DGS-based methods have attempted to model indirect lighting by characterizing indirect illumination as learnable lighting volumes or additional attributes of each Gaussian, while using baked occlusion to represent shadow effects. These methods, however, fail to accurately model the complex physical interactions between light and objects, making it impossible to construct realistic indirect illumination during relighting. To address this limitation, we propose to calculate indirect lighting using efficient path tracing with deferred shading. In our framework, we first render a G-buffer to capture the detailed geometry and material properties of the scene. Then, we perform physically-based rendering (PBR) only for direct lighting. With the G-buffer and previous rendering results, the indirect lighting can be calculated through a lightweight path tracing. Our method effectively models indirect lighting under any given lighting conditions, thereby achieving better novel view synthesis and competitive relighting. Quantitative and qualitative results show that our GI-GS outperforms existing baselines in both rendering quality and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。