提出混合3D表示方法,同时还原水下物体与水体效果。
Aquatic-GS: A Hybrid 3D Representation for Underwater Scenes
- 用神经水场建模水体参数,结合3D高斯点云显式表达物体
- 实现410倍加速的实时渲染,还原真实水下视觉效果
- 适合水下三维重建、图像复原等场景的应用研究者
水下3D场景表征是一项重要但复杂的任务,因成像过程中衰减与散射效应使物体与水体信息高度耦合,现有方法难以同时有效建模。为此,本文提出Aquatic-GS,一种融合水体与物体的混合3D表示方法。通过构建神经水场(NWF)隐式建模水体参数,并扩展最新3D高斯溅射(3DGS)显式建模物体,二者通过物理驱动的水下成像模型统一整合。为提升几何精度与细节,设计基于伪深度图的深度引导优化(DGO)机制。优化后,Aquatic-GS可生成新视角图像并恢复无水介质状态下的真实外观。在模拟与真实数据集上的实验表明,该方法超越现有水下3D表示方法,实现更优渲染质量与实时性能,速度提升410倍;在水下图像去水化方面,其色彩校正、细节恢复与稳定性均优于代表性方法。代码与数据集详见 https://aquaticgs.github.io。
原文摘要 · Abstract (English)
Representing underwater 3D scenes is a valuable yet complex task, as attenuation and scattering effects during underwater imaging significantly couple the information of the objects and the water. This coupling presents a significant challenge for existing methods in effectively representing both the objects and the water medium simultaneously. To address this challenge, we propose Aquatic-GS, a hybrid 3D representation approach for underwater scenes that effectively represents both the objects and the water medium. Specifically, we construct a Neural Water Field (NWF) to implicitly model the water parameters, while extending the latest 3D Gaussian Splatting (3DGS) to model the objects explicitly. Both components are integrated through a physics-based underwater image formation model to represent complex underwater scenes. Moreover, to construct more precise scene geometry and details, we design a Depth-Guided Optimization (DGO) mechanism that uses a pseudo-depth map as auxiliary guidance. After optimization, Aquatic-GS enables the rendering of novel underwater viewpoints and supports restoring the true appearance of underwater scenes, as if the water medium were absent. Extensive experiments on both simulated and real-world datasets demonstrate that Aquatic-GS surpasses state-of-the-art underwater 3D representation methods, achieving better rendering quality and real-time rendering performance with a 410x increase in speed. Furthermore, regarding underwater image restoration, Aquatic-GS outperforms representative dewatering methods in color correction, detail recovery, and stability. Our models, code, and datasets can be accessed at https://aquaticgs.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。