arXiv:2507.20507cs.CVeess.IV2025-07

研究不同空间上下文对海冰多任务分割的影响,指导模型设计

Investigating the Effect of Spatial Context on Multi-Task Sea Ice Segmentation

  • 用空洞金字塔控制感受野大小,捕捉多尺度上下文信息
  • 小感受野适合高分辨率SAR数据,大感受野反而降低性能
  • 融合SAR与AMSR2数据提升所有任务表现,低频通道价值显著

基于深度学习的海冰分割需在多尺度下捕捉空间上下文,但观测分辨率与任务特性如何影响最优上下文配置仍不明确。本研究通过多任务分割模型,分析海冰浓度、发育阶段和冰块尺寸分割中空间上下文的影响。采用不同空洞率的空洞空间金字塔池化(Atrous Spatial Pyramid Pooling),系统调控卷积操作的感受野,以获取多尺度上下文信息。研究探索了空间上下文与特征分辨率在不同海冰属性间的交互关系,并评估了来自哨兵-1 SAR与先进微波辐射计-2(AMSR2)的输入特征组合对多任务映射的影响。利用梯度加权类激活图(Gradient-weighted Class Activation Mapping)可视化空洞率对模型决策的影响。结果表明:小感受野在高分辨率哨兵-1数据上表现更优;中等感受野利于发育阶段分割;大感受野常导致性能下降。融合SAR与AMSR2数据显著提升所有任务表现。研究强调18.7和36.5 GHz低分辨率AMSR2通道在海冰制图中的重要性。本研究通过多任务设置系统分析感受野效应,为地理空间应用中深度学习模型优化提供依据。

原文摘要 · Abstract (English)

Capturing spatial context at multiple scales is crucial for deep learning-based sea ice segmentation. However, the optimal specification of spatial context based on observation resolution and task characteristics remains underexplored. This study investigates the impact of spatial context on the segmentation of sea ice concentration, stage of development, and floe size using a multi-task segmentation model. We implement Atrous Spatial Pyramid Pooling with varying atrous rates to systematically control the receptive field size of convolutional operations, and to capture multi-scale contextual information. We explore the interactions between spatial context and feature resolution for different sea ice properties and examine how spatial context influences segmentation performance across different input feature combinations from Sentinel-1 SAR and Advanced Microwave Radiometer-2 (AMSR2) for multi-task mapping. Using Gradient-weighted Class Activation Mapping, we visualize how atrous rates influence model decisions. Our findings indicate that smaller receptive fields excel for high-resolution Sentinel-1 data, while medium receptive fields yield better performances for stage of development segmentation and larger receptive fields often lead to diminished performances. The fusion of SAR and AMSR2 enhances segmentation across all tasks. We highlight the value of lower-resolution 18.7 and 36.5 GHz AMSR2 channels in sea ice mapping. These findings highlight the importance of selecting appropriate spatial context based on observation resolution and target properties in sea ice mapping. By systematically analyzing receptive field effects in a multi-task setting, our study provides insights for optimizing deep learning models in geospatial applications.

海冰分割多任务学习空间上下文遥感图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。