用高斯表示法快速还原透明物体的光照与形状
TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussians
- 引入透明高斯基元，通过延迟折射策略模拟光线穿透
- 融合环境光与周围物体信息，提升复杂场景还原精度
- 基于深度迭代查询减少视差误差，适合实时图形应用
神经辐射场与高斯基辐射场方法在新视角合成与3D重建中取得显著进展，但镜面反射与折射仍因辐射场对高频光变化的不稳定性与错误过拟合而面临挑战。即使3D高斯泼溅（3D-GS）作为高效工具，面对有邻近物体的透明物体时，仍因明显的二次光线效应难以恢复。为此，我们提出TransparentGS，一种基于3D-GS的快速透明物体逆渲染流水线。主要贡献有三：首先，设计了透明高斯基元，通过延迟折射策略实现光线穿透；其次，采用高斯光场探针（GaussProbe）在统一框架中编码环境光与邻近内容；第三，提出基于深度的迭代探针查询（IterQuery）算法，降低探针框架中的视差误差。实验表明，该方法在复杂环境下能高效准确地还原透明物体，并支持计算机图形学与视觉领域的多种应用。
原文摘要 · Abstract (English)
The emergence of neural and Gaussian-based radiance field methods has led to considerable advancements in novel view synthesis and 3D object reconstruction. Nonetheless, specular reflection and refraction continue to pose significant challenges due to the instability and incorrect overfitting of radiance fields to high-frequency light variations. Currently, even 3D Gaussian Splatting (3D-GS), as a powerful and efficient tool, falls short in recovering transparent objects with nearby contents due to the existence of apparent secondary ray effects. To address this issue, we propose TransparentGS, a fast inverse rendering pipeline for transparent objects based on 3D-GS. The main contributions are three-fold. Firstly, an efficient representation of transparent objects, transparent Gaussian primitives, is designed to enable specular refraction through a deferred refraction strategy. Secondly, we leverage Gaussian light field probes (GaussProbe) to encode both ambient light and nearby contents in a unified framework. Thirdly, a depth-based iterative probes query (IterQuery) algorithm is proposed to reduce the parallax errors in our probe-based framework. Experiments demonstrate the speed and accuracy of our approach in recovering transparent objects from complex environments, as well as several applications in computer graphics and vision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。