用自监督学习提升冰川裂解前沿提取精度,适合遥感与气候研究者。
SSL4SAR: Self-Supervised Learning for Glacier Calving Front Extraction from SAR Imagery
- 基于Sentinel数据构建自监督预训练集,融合雷达与光学影像。
- 新模型在基准数据上误差293米,比之前最优低67米。
- 集成模型逼近人类水平(误差75米),适合高精度冰川监测。
冰川正以空前速度流失冰量,亟需全年精准监测其裂解过程。深度学习可从合成孔径雷达(SAR)图像中提取裂解前沿位置,追踪海洋和湖泊末端冰川的季节性冰量损失。现有最佳模型依赖ImageNet预训练权重,但因自然图像与遥感图像存在领域差异,效果受限。为此,本文提出两种新颖的自监督多模态预训练方法,基于全新无标注数据集SSL4SAR,包含9,563幅哨兵-1 SAR图像和14幅哨兵-2光学图像(每条冰川对应一幅光学图)。同时引入混合模型架构:结合Swin Transformer编码器与残差卷积神经网络解码器。在CaFFe基准数据集上,该模型预训练后均方距离误差为293米,优于先前最优模型67米。多标注员评估显示集成模型误差降至75米,接近人类水平(38米)。此进展实现了对冰川裂解前沿季节变化的精确监测。
原文摘要 · Abstract (English)
Glaciers are losing ice mass at unprecedented rates, increasing the need for accurate, year-round monitoring to understand frontal ablation, particularly the factors driving the calving process. Deep learning models can extract calving front positions from Synthetic Aperture Radar imagery to track seasonal ice losses at the calving fronts of marine- and lake-terminating glaciers. The current state-of-the-art model relies on ImageNet-pretrained weights. However, they are suboptimal due to the domain shift between the natural images in ImageNet and the specialized characteristics of remote sensing imagery, in particular for Synthetic Aperture Radar imagery. To address this challenge, we propose two novel self-supervised multimodal pretraining techniques that leverage SSL4SAR, a new unlabeled dataset comprising 9,563 Sentinel-1 and 14 Sentinel-2 images of Arctic glaciers, with one optical image per glacier in the dataset. Additionally, we introduce a novel hybrid model architecture that combines a Swin Transformer encoder with a residual Convolutional Neural Network (CNN) decoder. When pretrained on SSL4SAR, this model achieves a mean distance error of 293 m on the "CAlving Fronts and where to Find thEm" (CaFFe) benchmark dataset, outperforming the prior best model by 67 m. Evaluating an ensemble of the proposed model on a multi-annotator study of the benchmark dataset reveals a mean distance error of 75 m, approaching the human performance of 38 m. This advancement enables precise monitoring of seasonal changes in glacier calving fronts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。