用全景图重建水下场景,解决畸变和介质退化问题。
Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting

- 直接在球面空间射线投射,减少360度视角畸变。
- 融合物理模型分离光照与散射,恢复真实水下外观。
- 新数据集+开源代码,适合水下三维重建研究者。
水下场景重建对沉浸式探索水生环境至关重要,但受吸收、散射等复杂介质效应及传统相机视场有限的挑战。尽管结合全景成像与3D高斯点阵(3DGS)为逼真水下渲染提供了前景,传统3DGS在球面投影畸变和水下介质退化方面仍表现不佳。本文提出 extbf{Underwater360},一种基于物理信息的全景3DGS框架用于水下全景场景重建。首先,引入全景高斯点阵模块,在球面相机空间直接进行射线投射,避免依赖二维投影近似,显著降低360°视场下的几何畸变。其次,设计基于物理的外观-介质建模架构,结合姿态条件外观嵌入,显式解耦场景固有辐射率与深度相关的后向散射及衰减,实现物理合理的外观恢复。最后,构建包含合成与真实场景的新全景水下基准数据集。大量实验表明,Underwater360在水下新视角合成与场景外观恢复上均表现优异,提升了复杂水下环境中的渲染质量与跨视角一致性。代码与数据集已开源。
原文摘要 · Abstract (English)
Underwater scene reconstruction is essential for immersive exploration of aquatic environments, yet remains challenging due to complex participating-media effects such as absorption and scattering, as well as the limited field of view (FoV) of conventional cameras. Although combining panoramic imaging with 3D Gaussian Splatting (3DGS) offers a promising direction for photorealistic underwater rendering, traditional 3DGS struggles with both spherical projection distortion and underwater medium degradation. In this paper, we propose \textbf{Underwater360}, a physics-informed omnidirectional 3DGS framework for underwater panoramic scene reconstruction. First, we introduce an Omnidirectional Gaussian Splatting module that performs ray casting directly in spherical camera space instead of relying on 2D projection approximations, thereby reducing geometric distortions under 360$^\circ$ FoV. Second, we design a physics-based appearance-medium modeling architecture with pose-conditioned appearance embeddings to explicitly decouple intrinsic scene radiance from depth-dependent backscatter and attenuation, enabling physically grounded scene appearance restoration. Finally, we establish a new panoramic underwater benchmark dataset containing both synthetic and real-world scenes. Extensive experiments demonstrate that Underwater360 achieves superior performance in underwater novel view synthesis and scene appearance restoration, delivering improved rendering quality and cross-view consistency in complex underwater environments. The code and datasets are released at https://github.com/SwcK423/Underwater360
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。