arXiv:2604.08171cs.CVcs.AI2026-04

针对海洋遥感数据少、模型迁移差问题,提出专用于海洋的自监督预训练模型。

OceanMAE: A Foundation Model for Ocean Remote Sensing

  • 用多光谱卫星数据加海洋物理特征训练自编码器,提升海洋感知能力
  • 在多个海洋污染和水深数据集上表现优异,尤其在污染物分割任务中领先
  • 适合做海洋监测、生态评估等领域的研究人员参考使用

精确的海洋制图对水深估计、海底特征分析、海洋垃圾检测和生态系统监测等应用至关重要。然而,海洋遥感仍受限于标注数据稀缺以及主要基于陆地影像预训练的模型迁移能力弱。本文提出OceanMAE,一种面向海洋的掩码自编码器,通过在自监督学习中融合多光谱哨兵-2数据与具有物理意义的海洋特征,扩展标准MAE预训练。该方法使模型从大规模无标签数据中学习更具信息量和海洋感知能力的隐表示。为将这些表征应用于下游任务,进一步采用改进的UNet框架进行海洋分割与水深估计。OceanMAE在Hydro数据集上预训练,分别在MADOS和MARIDA数据集上评估海洋污染物与废弃物分割,在MagicBathyNet上评估水深回归。实验表明,OceanMAE在海洋分割任务中取得最优效果,水深估计性能也具竞争力且依赖任务。此外,与标准MAE在MARIDA上的对比显示,预训练阶段引入辅助海洋特征可显著提升下游分割质量。结果表明,基于物理先验与领域对齐的自监督预训练对海洋遥感具有重要价值。代码与权重公开于https://git.tu-berlin.de/joanna.stamer/SSLORS2。

原文摘要 · Abstract (English)

Accurate ocean mapping is essential for applications such as bathymetry estimation, seabed characterization, marine litter detection, and ecosystem monitoring. However, ocean remote sensing (RS) remains constrained by limited labeled data and by the reduced transferability of models pre-trained mainly on land-dominated Earth observation imagery. In this paper, we propose OceanMAE, an ocean-specific masked autoencoder that extends standard MAE pre-training by integrating multispectral Sentinel-2 observations with physically meaningful ocean descriptors during self-supervised learning. By incorporating these auxiliary ocean features, OceanMAE is designed to learn more informative and ocean-aware latent representations from large- scale unlabeled data. To transfer these representations to downstream applications, we further employ a modified UNet-based framework for marine segmentation and bathymetry estimation. Pre-trained on the Hydro dataset, OceanMAE is evaluated on MADOS and MARIDA for marine pollutant and debris segmentation, and on MagicBathyNet for bathymetry regression. The experiments show that OceanMAE yields the strongest gains on marine segmentation, while bathymetry benefits are competitive and task-dependent. In addition, an ablation against a standard MAE on MARIDA indicates that incorporating auxiliary ocean descriptors during pre-training improves downstream segmentation quality. These findings highlight the value of physically informed and domain-aligned self-supervised pre- training for ocean RS. Code and weights are publicly available at https://git.tu-berlin.de/joanna.stamer/SSLORS2.

海洋遥感自监督学习水深估计分割模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。