提出新型注意力机制,精准去除遥感图像云层干扰
Attentive Contextual Attention for Cloud Removal
- 动态学习注意力权重,过滤云区噪声和无关特征
- 在多个数据集上显著提升去云后图像清晰度与一致性
- 可嵌入多种模型,适合遥感图像处理研究者使用
云层覆盖严重阻碍遥感图像在地球观测中的应用,亟需改进去云技术。近年来,深度学习方法通过卷积提取局部特征、注意力机制获取长程信息,在场景理解上表现优异。但现有方法常导致图像模糊、伪影和不一致,因注意力机制基于通用相似度对所有特征加权,可能引入云区噪声和无关细节。为此,本文提出新颖的注意力机制——有关注上下文注意力(AC-Attention),通过数据驱动方式动态学习注意力选择分数,有效过滤噪声与无关特征。将该模块集成至DSen2-CR框架后,显著增强模型对远距离关键信息的捕捉能力,实现更优的去云效果。广泛实验表明,本方法在多个数据集上均优于现有方法。消融实验证明其在多种网络架构中具备良好适应性,能聚焦相关特征,提升整体性能。代码已开源。
原文摘要 · Abstract (English)
Cloud cover can significantly hinder the use of remote sensing images for Earth observation, prompting urgent advancements in cloud removal technology. Recently, deep learning strategies have shown strong potential in restoring cloud-obscured areas. These methods utilize convolution to extract intricate local features and attention mechanisms to gather long-range information, improving the overall comprehension of the scene. However, a common drawback of these approaches is that the resulting images often suffer from blurriness, artifacts, and inconsistencies. This is partly because attention mechanisms apply weights to all features based on generalized similarity scores, which can inadvertently introduce noise and irrelevant details from cloud-covered areas. To overcome this limitation and better capture relevant distant context, we introduce a novel approach named Attentive Contextual Attention (AC-Attention). This method enhances conventional attention mechanisms by dynamically learning data-driven attentive selection scores, enabling it to filter out noise and irrelevant features effectively. By integrating the AC-Attention module into the DSen2-CR cloud removal framework, we significantly improve the model's ability to capture essential distant information, leading to more effective cloud removal. Our extensive evaluation of various datasets shows that our method outperforms existing ones regarding image reconstruction quality. Additionally, we conducted ablation studies by integrating AC-Attention into multiple existing methods and widely used network architectures. These studies demonstrate the effectiveness and adaptability of AC-Attention and reveal its ability to focus on relevant features, thereby improving the overall performance of the networks. The code is available at \url{https://github.com/huangwenwenlili/ACA-CRNet}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。