用深度学习补全遥感影像中的海底深度空白区,提升测深精度与完整性。
Deep Learning-based Bathymetry Retrieval without In-situ Depths using Remote Sensing Imagery and SfM-MVS DSMs with Data Gaps
- 融合SfM-MVS与深度学习,以有缺损的三维海床模型为训练数据
- 在地中海和波罗的海测试中,测深精度、覆盖度和噪声抑制显著提升
- 新模型Swin-BathyUNet可独立使用,适用于多种训练数据场景
精确、详细且高频的浅海海底地形数据对面临强烈气候与人为压力的区域至关重要。现有利用航空或卫星光学影像反演水深的方法主要依赖SfM-MVS结合折射校正或光谱反演法(SDB)。但SDB常需大量人工野外工作或昂贵参考数据,而SfM-MVS即使经折射校正,仍存在深度数据缺失与均质视觉纹理环境下的噪声问题,影响海床数字表面模型(DSMs)的准确性和完整性。为此,本文提出一种新方法,将SfM-MVS的高保真三维重建能力与先进折射校正技术,结合新型基于深度学习的光谱反演能力进行融合。该方法利用带有数据空缺的SfM-MVS DSM作为训练数据,生成完整水深图。提出Swin-BathyUNet模型,结合U-Net结构与Swin Transformer自注意力机制及交叉注意力模块,专用于水深反演。该模型能捕捉长程空间关系,提升水深预测精度,亦可作为独立方案应用于标准SDB任务,不依赖SfM-MVS输出。在地中海与波罗的海两个不同测试区域的实验验证了该方法在水深精度、细节、覆盖范围和降噪方面的显著提升。代码已开源:https://github.com/pagraf/Swin-BathyUNet。
原文摘要 · Abstract (English)
Accurate, detailed, and high-frequent bathymetry is crucial for shallow seabed areas facing intense climatological and anthropogenic pressures. Current methods utilizing airborne or satellite optical imagery to derive bathymetry primarily rely on either SfM-MVS with refraction correction or Spectrally Derived Bathymetry (SDB). However, SDB methods often require extensive manual fieldwork or costly reference data, while SfM-MVS approaches face challenges even after refraction correction. These include depth data gaps and noise in environments with homogeneous visual textures, which hinder the creation of accurate and complete Digital Surface Models (DSMs) of the seabed. To address these challenges, this work introduces a methodology that combines the high-fidelity 3D reconstruction capabilities of the SfM-MVS methods with state-of-the-art refraction correction techniques, along with the spectral analysis capabilities of a new deep learning-based method for bathymetry prediction. This integration enables a synergistic approach where SfM-MVS derived DSMs with data gaps are used as training data to generate complete bathymetric maps. In this context, we propose Swin-BathyUNet that combines U-Net with Swin Transformer self-attention layers and a cross-attention mechanism, specifically tailored for SDB. Swin-BathyUNet is designed to improve bathymetric accuracy by capturing long-range spatial relationships and can also function as a standalone solution for standard SDB with various training depth data, independent of the SfM-MVS output. Experimental results in two completely different test sites in the Mediterranean and Baltic Seas demonstrate the effectiveness of the proposed approach through extensive experiments that demonstrate improvements in bathymetric accuracy, detail, coverage, and noise reduction in the predicted DSM. The code is available at https://github.com/pagraf/Swin-BathyUNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。