分离几何与光学属性,实现半透明反光表面的清晰成像。
RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting

- 将高斯分布的几何占据与光学不透明度解耦,统一建模。
- 实测在复杂半透明场景中实现高清反射与清晰透射,实时渲染。
- 适合需要精确光影处理的3D重建与编辑任务。
3D高斯点阵(3DGS)实现了高质量的实时新视角合成。然而,现有方法在处理兼具复杂反射与清晰透射的半透明镜面表面时表现不佳,常导致反射模糊或透射过度遮挡。为此,我们提出RT-Splatting,将每个高斯分布的几何占据与其光学不透明度解耦,形成统一的表面-体积联合场景表示,仅用一组高斯基元。我们的混合渲染器同时将其视为表面以捕捉高频反射,又视为体积以保留清晰透射。为缓解反射与透射联合优化中的歧义,引入镜面感知梯度门控机制,抑制高度镜面区域对透射分支的误导性梯度,有效减少干扰性浮动伪影。在挑战性半透明场景上的实验表明,RT-Splatting达到当前最优性能,实现高保真反射与清晰透射,且支持实时渲染。此外,该解耦机制天然支持灵活场景编辑。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often producing blurry reflections or overly occluded transmission. To address this, we present RT-Splatting, a framework that disentangles each Gaussian's geometric occupancy from its optical opacity. This factorization yields a unified surface-volume scene representation with a single set of Gaussian primitives. Our hybrid renderer interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission. To mitigate the ambiguity in jointly optimizing reflection and transmission, we introduce Specular-Aware Gradient Gating, which suppresses misleading gradients from highly specular regions into the transmission branch, effectively reducing distracting floaters. Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering. Moreover, our factorization naturally enables flexible scene editing. The project page is available at https://sjj118.github.io/RT-Splatting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。