让高斯点阵同时渲染反光与透光，提升真实感新视角合成。
RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives
- 用独立的高斯原语分别建模反射与透射效果。
- 在复杂场景中成功还原透明物体后的结构和远处反光。
- 适合需要高真实感三维重建的研究者与工程师。
高斯点阵是重建漫反射场景的强大工具，但在同时建模镜面反射和半透明表面后方物体外观方面存在困难。这些镜面反射和透射现象对真实感新视角合成至关重要，而现有方法未能合理引入底层物理过程进行模拟。为此，我们提出RT-GS，一种统一框架，将微表面材质模型与光线追踪结合，在高斯点阵中联合建模镜面反射与透射。通过为反射和透射使用独立的高斯原语，可并行实现远距离反射建模与透明物体后方结构重建。采用可微分光线追踪框架获取镜面反射与透射外观。实验表明，本方法在复杂环境中成功生成反射并恢复透明物体后的对象，相比先前方法在显著突出的镜面光相互作用场景中取得显著定性提升。
原文摘要 · Abstract (English)
Gaussian Splatting is a powerful tool for reconstructing diffuse scenes, but it struggles to simultaneously model specular reflections and the appearance of objects behind semi-transparent surfaces. These specular reflections and transmittance are essential for realistic novel view synthesis, and existing methods do not properly incorporate the underlying physical processes to simulate them. To address this issue, we propose RT-GS, a unified framework that integrates a microfacet material model and ray tracing to jointly model specular reflection and transmittance in Gaussian Splatting. We accomplish this by using separate Gaussian primitives for reflections and transmittance, which allow modeling distant reflections and reconstructing objects behind transparent surfaces concurrently. We utilize a differentiable ray tracing framework to obtain the specular reflection and transmittance appearance. Our experiments demonstrate that our method successfully produces reflections and recovers objects behind transparent surfaces in complex environments, achieving significant qualitative improvements over prior methods where these specular light interactions are prominent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。