arXiv:2604.23551cs.CV2026-04被引 1

提出新方法,让水下3D重建更真实,能同时处理光影和运动干扰。

Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction

论文配图:Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction
图 1 · 摘自论文原文
  • 用成对的高斯点分别表示真实场景和受干扰的观测,物理建模退化过程。
  • 在模拟和真实数据上均超越现有方法,生成无水雾、更清晰的新视角图像。
  • 适合水下视觉、三维重建、海洋探测等领域的研究者与开发者。

从水下视频重建逼真的三维场景仍是多媒体领域的重要挑战。水下成像固有的时空退化现象,包括光斑、闪烁、衰减和后向散射,常导致现有三维重建方法在几何与外观上失真。尽管少数近期工作探索了退化感知重建,但大多仅考虑空间或时间退化之一,在同时存在两类退化的实际水下场景中表现不足。本文提出 MarineSTD-GS,一种基于3D高斯溅射的新型框架,显式建模时空退化以实现更真实的水下场景重建。具体而言,引入成对的高斯原语:内在高斯点代表真实场景,退化高斯点渲染退化观测。每个退化高斯的颜色通过时空退化建模(SDM)模块从其对应的内在高斯物理推导而来,实现从退化图像中自监督解耦出真实外观。为保证训练稳定与几何准确,进一步提出深度引导几何损失和多阶段优化策略。我们还构建了一个包含多样时空退化的模拟基准,配有真实外观标注,用于全面评估。在模拟与真实数据集上的实验表明,MarineSTD-GS 能稳健应对时空退化,在新视角合成中生成更真实、无水雾的场景外观,优于现有方法。

原文摘要 · Abstract (English)

Reconstructing realistic underwater scenes from underwater video remains a meaningful yet challenging task in the multimedia domain. The inherent spatiotemporal degradations in underwater imaging, including caustics, flickering, attenuation, and backscattering, frequently result in inaccurate geometry and appearance in existing 3D reconstruction methods. While a few recent works have explored underwater degradation-aware reconstruction, they often address either spatial or temporal degradation alone, falling short in more real-world underwater scenarios where both types of degradation occur. We propose MarineSTD-GS, a novel 3D Gaussian Splatting-based framework that explicitly models both temporal and spatial degradations for realistic underwater scene reconstruction. Specifically, we introduce two paired Gaussian primitives: Intrinsic Gaussians represent the true scene, while Degraded Gaussians render the degraded observations. The color of each Degraded Gaussian is physically derived from its paired Intrinsic Gaussian via a Spatiotemporal Degradation Modeling (SDM) module, enabling self-supervised disentanglement of realistic appearance from degraded images. To ensure stable training and accurate geometry, we further propose a Depth-Guided Geometry Loss and a Multi-Stage Optimization strategy. We also construct a simulated benchmark with diverse spatial and temporal degradations and ground-truth appearances for comprehensive evaluation. Experiments on both simulated and real-world datasets show that MarineSTD-GS robustly handles spatiotemporal degradations and outperforms existing methods in novel view synthesis with realistic, water-free scene appearances.

水下重建3D高斯退化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。