arXiv:2510.10802cs.CVcs.AI2025-10被引 1

用多尺度注意力融合光谱信息,提升卫星云图分割精度

MSCloudCAM: Multi-Scale Context Adaptation with Convolutional Cross-Attention for Multispectral Cloud Segmentation

  • 设计卷积交叉注意力模块,动态融合不同尺度上下文特征
  • 在CloudSEN12和L8Biome数据集上达到最优整体分割性能
  • 适合遥感图像分析、地球观测领域的研究者与工程师

云仍是光学卫星成像中的主要障碍,限制了环境与气候分析的准确性。为应对云类型间强烈的光谱差异与尺度变化,本文提出MSCloudCAM——一种基于卷积交叉注意力的多尺度上下文适配网络,专用于多光谱、多传感器云分割。核心创新在于显式建模多个互补的多尺度上下文提取器,并非简单堆叠或拼接输出,而是利用一个提取器的细粒度特征与另一提取器的全局上下文表征,实现动态、尺度感知的特征选择。在此基础上,设计新型卷积交叉注意力适配器,有效融合局部细节与多尺度上下文信息。结合分层视觉主干网络,并通过通道与空间注意力机制优化,实现了强大的光谱-空间区分能力。在CloudSEN12(Sentinel-2)与L8Biome(Landsat-8)等多个多传感器数据集上的实验表明,MSCloudCAM在整体分割性能上优于现有先进模型,类别的准确率也具竞争力,同时保持合理模型复杂度,验证了其在大规模地球观测中的有效性与新颖性。

原文摘要 · Abstract (English)

Clouds remain a major obstacle in optical satellite imaging, limiting accurate environmental and climate analysis. To address the strong spectral variability and the large scale differences among cloud types, we propose MSCloudCAM, a novel multi-scale context adapter network with convolution based cross-attention tailored for multispectral and multi-sensor cloud segmentation. A key contribution of MSCloudCAM is the explicit modeling of multiple complementary multi-scale context extractors. And also, rather than simply stacking or concatenating their outputs, our formulation uses one extractor's fine-resolution features and the other extractor's global contextual representations enabling dynamic, scale-aware feature selection. Building on this idea, we design a new convolution-based cross attention adapter that effectively fuses localized, detailed information with broader multi-scale context. Integrated with a hierarchical vision backbone and refined through channel and spatial attention mechanisms, MSCloudCAM achieves strong spectral-spatial discrimination. Experiments on various multisensor datatsets e.g. CloudSEN12 (Sentinel-2) and L8Biome (Landsat-8), demonstrate that MSCloudCAM achieves superior overall segmentation performance and competitive class-wise accuracy compared to recent state-of-the-art models, while maintaining competitive model complexity, highlighting the novelty and effectiveness of the proposed design for large-scale Earth observation.

云分割多光谱注意力机制遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。