arXiv:2603.21695cs.CVcs.GR2026-03

让3D高斯模型学会穿水看世界,真实还原波浪扭曲效果。

RefracGS: Novel View Synthesis Through Refractive Water Surfaces with 3D Gaussian Ray Tracing

  • 用神经高度场建模水面,3D高斯表示水下场景,分开处理折射边界
  • 基于斯涅尔定律计算弯曲光路,实现真实折射渲染,训练快15倍
  • 适合做水下视觉重建、影视特效或虚拟拍摄的科研与工程人员

通过非平面折射表面进行新视角合成面临严重空间变化的光学畸变。尽管NeRF和3D高斯溅射(3DGS)在常规新视角合成中表现优异,但其假设光线直线传播的特性在折射条件下失效,导致显著伪影。为此,我们提出RefracGS,联合重建折射水面与水面下的场景。核心思想是将折射边界与目标物体显式解耦:水面由神经高度场建模以捕捉波形几何,水下场景则用3D高斯场表示。我们提出一种折射感知的高斯光线追踪方法,基于斯涅尔定律精确计算非线性光路,并高效渲染底层高斯场,同时反向传播损失梯度至参数化水面。通过端到端联合优化两个表示,方法实现了高保真新视角合成与视图一致的表面恢复。在包含复杂波浪的合成与真实场景上的实验表明,RefracGS在视觉质量上超越先前折射方法,且训练速度提升15倍,实现实时渲染达200 FPS。

原文摘要 · Abstract (English)

Novel view synthesis (NVS) through non-planar refractive surfaces presents fundamental challenges due to severe, spatially varying optical distortions. While recent representations like NeRF and 3D Gaussian Splatting (3DGS) excel at NVS, their assumption of straight-line ray propagation fails under these conditions, leading to significant artifacts. To overcome this limitation, we introduce RefracGS, a framework that jointly reconstructs the refractive water surface and the scene beneath the interface. Our key insight is to explicitly decouple the refractive boundary from the target objects: the refractive surface is modeled via a neural height field, capturing wave geometry, while the underlying scene is represented as a 3D Gaussian field. We formulate a refraction-aware Gaussian ray tracing approach that accurately computes non-linear ray trajectories using Snell's law and efficiently renders the underlying Gaussian field while backpropagating the loss gradients to the parameterized refractive surface. Through end-to-end joint optimization of both representations, our method ensures high-fidelity NVS and view-consistent surface recovery. Experiments on both synthetic and real-world scenes with complex waves demonstrate that RefracGS outperforms prior refractive methods in visual quality, while achieving 15x faster training and real-time rendering at 200 FPS. The project page for RefracGS is available at https://yimgshao.github.io/refracgs/.

新视角合成折射建模3D高斯

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。