构建首个面向海冰类型分割的通用大模型评测基准,解决遥感大模型在极地应用中的迁移难题。
Ice-FMBench: A Foundation Model Benchmark for Sea Ice Type Segmentation
- 提出IceFMBench基准,整合标准数据集与多评估指标,支持新模型接入对比。
- 验证主流遥感大模型在极地SAR影像上表现受限,尤其跨时空调迁能力弱。
- 设计多教师知识蒸馏方法,提升模型在不同时空场景下的泛化性能,适合极地遥感研究者。
准确分割与制图海冰类型对极地航行、海上作业和气候监测至关重要。尽管深度学习在自动化海冰类型分割方面展现出巨大潜力,但其成功通常依赖于大量专家标注数据,而此类数据的构建成本高且耗时。近年来,通过大规模自监督训练的基座模型(FMs)表现出优异性能。然而,由于海冰具有复杂的物理特征、显著的季节变化以及合成孔径雷达(SAR)特有的条带状伪影、波纹效应和异质后向散射等问题,且极地SAR数据常使用与低纬度地区不同的传感器模式采集,导致现有基座模型难以直接迁移至极地环境。为此,本文贡献:(1) 构建IceFMBench——一个基于哨兵1号SAR影像的海冰类型分割基座模型综合评测框架,包含广泛使用的标准数据集、多样化的评估指标及一组适用于海冰分割的代表性遥感基座模型,并具备支持新模型并行加入的能力;(2) 利用IceFMBench对代表性基座模型进行广泛对比评估,并通过案例研究分析最优模型在跨时空域上的迁移能力;(3) 提出一种多教师知识蒸馏方法,以缓解模型在时空维度上的迁移不足问题。
原文摘要 · Abstract (English)
Accurate segmentation and mapping of sea ice types is crucial for safe polar navigation, offshore operations, and climate monitoring. While deep learning has demonstrated strong potential for automating sea ice type segmentation, its success often relies on access to extensive expert labeled datasets, which is both resource intensive and time consuming to create. However, foundation models (FMs), recently developed through self-supervised training on large-scale datasets, have demonstrated impressive performance. Nevertheless, their applicability to sea ice type segmentation based on Synthetic Aperture Radar (SAR) imagery remains uncertain due to the unique challenges posed by sea ice such as intricate geophysical patterns, pronounced seasonal variability, and SAR-specific artifacts like banding, scalloping, and heterogeneous backscatter as well as the fact that SAR data in polar regions are often acquired using specialized sensor modes that differ markedly from those used to collect FM training data at lower latitudes, limiting their direct transferability to polar environments. To address this gap, we contribute: (1) IceFMBench, a comprehensive benchmark framework for evaluation of the state-of-the-art remote sensing FMs on the sea ice type segmentation task using Sentinel1 SAR imagery, where IceFMBench is composed of a widely used standardized dataset, diverse evaluation metrics, and a representative set of selected remote sensing FM models suitable for sea ice type segmentation, with the ability to include new models side by side the existing models; (2) an extensive comparative evaluation of the representative FMs using IceFMBench, with additional case studies to assess performance of the top-performing model in terms of transferability across temporal and spatial domains and (3) a multi teacher knowledge distillation approach to address lack of spatiotemporal transferability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。