用信息对齐技术解决南极冰区卫星图像错位问题,实现稀疏标注下的精准冰面分割。
Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone

- 通过互信息配准算法对齐不同传感器图像,解决动态冰区的时空错位问题。
- 在43个场景中仅用2088个像素级标签,实现高精度海冰分割。
- 适合研究遥感图像融合、极地环境监测与弱监督学习的学者参考。
多模态卫星影像为地球观测提供互补信息,但在动态环境中准确融合异构传感器数据仍具挑战。南极边缘冰区等快速变化区域因地表特征在成像时间间隔间移动,导致多源影像存在空间与时间错位,破坏了像素级对应关系这一多数多模态推理和下游分类流程的基础假设。南极海冰因冰块漂移复杂且对雷达、可见光及热红外感应响应各异,成为极具挑战性的基准任务。精确密集的海冰标注稀缺,因逐像素标注需专家耗时解析噪声数据,以往模型训练长期依赖粗分辨率海事冰图。本文提出基于互信息配准的新架构,用于对齐多卫星(Sentinel-1与MODIS平台)多模态(可见光、热红外、雷达)影像。为验证方法,我们构建了一个稀疏专家标注数据集,包含2,088个像素级标注(7,046个专家点分类),覆盖43个场景的冰水交界区域。结果表明,先进行空间对齐再分割可显著提升分类精度,并实现从稀疏点标注中生成准确、密集的海冰分割结果。
原文摘要 · Abstract (English)
Multimodal satellite imagery provides complementary information for Earth Observation, but accurately combining heterogeneous sensors remains challenging in dynamic environments. Fast-changing regions, such as the Antarctic marginal ice zone, cannot fully exploit multimodal information from different satellite sensors because surface features move between image acquisitions. This spatial and temporal mismatch challenges effective perceptual grounding, violating the assumption of pixel-level correspondence that underpins most multimodal reasoning and downstream classification pipelines. Antarctic sea ice provides a challenging benchmark due to the rapid, heterogeneous drift of individual ice floes and the differing responses of sea ice to radar, visible and thermal sensing modalities. Accurate, dense supervision of sea ice remains scarce because generating pixel-wise labels requires time-consuming expert interpretation of noisy data, leading to historical reliance on coarse-resolution maritime ice charts for model training. This paper presents a novel architecture based on mutual information warping to align multi-satellite (Sentinel-1 and MODIS platforms) multimodal (visible, thermal, radar) satellite scenes. To demonstrate the approach, we introduce a sparse expert-labeled dataset of 2,088 pixel-wise annotations (7,046 expert point classifications) located at the ice-water margin interface across 43 scenes. Our results demonstrate that spatially grounding and aligning modalities prior to segmentation improves classification accuracy, and enables accurate, dense sea ice segmentation from sparse point-wise supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。