首个融合水下光学特性的实时3D重建与复原方法
WaterClear-GS: Optical-Aware Gaussian Splatting for Underwater Reconstruction and Restoration
- 将水下光衰减和散射模型直接嵌入高斯点,无需额外介质网络
- 在标准数据集上实现优于现有方法的视图合成与图像复原效果
- 适合水下机器人、海洋观测等需要实时高清视觉的应用场景
水下三维重建与外观复原受水体复杂光学特性(如波长相关衰减和散射)制约。现有基于神经辐射场(NeRF)的方法渲染速度慢且色彩复原不佳,而3D高斯泼溅(3DGS)本身无法建模复杂的体积散射效应。为此,我们提出WaterClear-GS,首个纯3DGS框架,将局部衰减与散射的水下光学特性显式融入高斯基元,无需辅助介质网络。该方法采用双分支优化策略,在保证水下光照一致性的同时自然恢复无水外观。通过深度引导几何正则化、感知驱动图像损失、曝光约束、空间自适应正则化及物理引导光谱正则化,共同强化局部3D一致性并保持自然视觉感知。在标准基准与新采集数据集上的实验表明,WaterClear-GS在新视角合成(NVS)和水下图像复原(UIR)任务中均表现优异,且支持实时渲染。
原文摘要 · Abstract (English)
Underwater 3D reconstruction and appearance restoration are hindered by the complex optical properties of water, such as wavelength-dependent attenuation and scattering. Existing Neural Radiance Fields (NeRF)-based methods struggle with slow rendering speeds and suboptimal color restoration, while 3D Gaussian Splatting (3DGS) inherently lacks the capability to model complex volumetric scattering effects. To address these issues, we introduce WaterClear-GS, the first pure 3DGS-based framework that explicitly integrates underwater optical properties of local attenuation and scattering into Gaussian primitives, eliminating the need for an auxiliary medium network. Our method employs a dual-branch optimization strategy to ensure underwater photometric consistency while naturally recovering water-free appearances. This strategy is enhanced by depth-guided geometry regularization and perception-driven image loss, together with exposure constraints, spatially-adaptive regularization, and physically guided spectral regularization, which collectively enforce local 3D coherence and maintain natural visual perception. Experiments on standard benchmarks and our newly collected dataset demonstrate that WaterClear-GS achieves outstanding performance on both novel view synthesis (NVS) and underwater image restoration (UIR) tasks, while maintaining real-time rendering. The code will be available at https://buaaxrzhang.github.io/WaterClear-GS/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。