用3D高斯表示玻璃反射透射，实现实时高保真渲染。
TR-Gaussians: High-fidelity Real-time Rendering of Planar Transmission and Reflection with 3D Gaussian Splatting
- 将3D高斯与可学习反射平面结合，显式建模玻璃视点相关反射。
- 通过菲涅尔加权融合透射与反射分量，还原复杂视角下的真实外观。
- 支持实时渲染，适合含玻璃的室内场景重建与可视化。
我们提出传输-反射高斯（TR-Gaussians），一种基于3D高斯的新表示方法，用于高保真渲染平面透射与反射效果，这些在室内场景中普遍存在。该方法将3D高斯与可学习的反射平面结合，显式建模玻璃平面及其视点依赖的反射强度。真实场景与透射成分由3D高斯建模，反射成分则由相对于反射平面镜像的高斯建模。透射与反射分量根据基于菲涅尔的视点依赖加权方案进行融合，实现不同视角下复杂外观效果的真实合成。为有效优化TR-Gaussians，我们设计了包含颜色与几何约束的多阶段优化框架，并引入不透明度扰动机制。在多个数据集上的实验表明，TR-Gaussians 在含平面透射与反射的场景中实现了实时、高保真新视角合成，且在定量与定性上均优于当前最优方法。
原文摘要 · Abstract (English)
We propose Transmission-Reflection Gaussians (TR-Gaussians), a novel 3D-Gaussian-based representation for high-fidelity rendering of planar transmission and reflection, which are ubiquitous in indoor scenes. Our method combines 3D Gaussians with learnable reflection planes that explicitly model the glass planes with view-dependent reflectance strengths. Real scenes and transmission components are modeled by 3D Gaussians and the reflection components are modeled by the mirrored Gaussians with respect to the reflection plane. The transmission and reflection components are blended according to a Fresnel-based, view-dependent weighting scheme, allowing for faithful synthesis of complex appearance effects under varying viewpoints. To effectively optimize TR-Gaussians, we develop a multi-stage optimization framework incorporating color and geometry constraints and an opacity perturbation mechanism. Experiments on different datasets demonstrate that TR-Gaussians achieve real-time, high-fidelity novel view synthesis in scenes with planar transmission and reflection, and outperform state-of-the-art approaches both quantitatively and qualitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。