用双重策略提升云检测精度,尤其改善薄云和边界模糊区域的识别。
CloudMamba: An Uncertainty-Guided Dual-Scale Mamba Network for Cloud Detection in Remote Sensing Imagery
- 分两阶段检测:先估不确定性,再对低置信区域精细优化。
- 在GF1_WHU和Levir_CS数据集上,mAP比现有方法提升2.3%以上。
- 结合CNN与Mamba结构,速度快且适合遥感图像的细粒度分析。
遥感图像中的云检测是基础且极具挑战性的问题。现有深度学习方法多采用单阶段像素级二分类分割,但在薄云区域存在歧义和不确定性,难以准确处理碎片化云体及边界细节。本文提出CloudMamba框架,引入不确定性引导的两阶段检测策略:通过嵌入式不确定性估计模块自动量化薄云分割置信度,并设计第二阶段细化分割以提升低置信度难区域的精度。为更好捕捉碎片云与精细边界,构建基于CNN-Mamba混合架构的双尺度网络,相比具有二次计算复杂度的Transformer模型,本方法保持线性复杂度,有效捕获云体的大尺度结构特征与小尺度边界细节,实现整体形态精准勾画与边界精确分割。在GF1_WHU和Levir_CS公开数据集上的大量实验表明,该方法在多个分割精度指标上优于现有方法,同时具备高效率与过程可解释性。代码已开源。
原文摘要 · Abstract (English)
Cloud detection in remote sensing imagery is a fundamental, critical, and highly challenging problem. Existing deep learning-based cloud detection methods generally formulate it as a single-stage pixel-wise binary segmentation task with one forward pass. However, such single-stage approaches exhibit ambiguity and uncertainty in thin-cloud regions and struggle to accurately handle fragmented clouds and boundary details. In this paper, we propose a novel deep learning framework termed CloudMamba. To address the ambiguity in thin-cloud regions, we introduce an uncertainty-guided two-stage cloud detection strategy. An embedded uncertainty estimation module is proposed to automatically quantify the confidence of thin-cloud segmentation, and a second-stage refinement segmentation is introduced to improve the accuracy in low-confidence hard regions. To better handle fragmented clouds and fine-grained boundary details, we design a dual-scale Mamba network based on a CNN-Mamba hybrid architecture. Compared with Transformer-based models with quadratic computational complexity, the proposed method maintains linear computational complexity while effectively capturing both large-scale structural characteristics and small-scale boundary details of clouds, enabling accurate delineation of overall cloud morphology and precise boundary segmentation. Extensive experiments conducted on the GF1_WHU and Levir_CS public datasets demonstrate that the proposed method outperforms existing approaches across multiple segmentation accuracy metrics, while offering high efficiency and process transparency. Our code is available at https://github.com/jayoungo/CloudMamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。