arXiv:2501.07901cs.CVeess.IV2025-01

用雷达与光学图像融合,修复云遮挡的遥感影像。

Cloud Removal With PolSAR-Optical Data Fusion Using A Two-Flow Residual Network

  • 双流残差网络并行提取雷达与光学特征,动态滤波降噪。
  • 跨模态跳接融合+注意力机制,提升多源数据协同效果。
  • 在OPT-BCFSAR-PFSAR数据集上表现超越现有方法。

光学遥感影像在地表观测中至关重要,但云层覆盖导致完整影像获取困难。本文提出一种基于双流残差网络的PolSAR-光学数据融合云去除算法(PODF-CR),实现缺失光学影像的重建。该算法包含编码与解码模块:编码模块含两条并行分支,分别提取PolSAR图像特征与光学图像特征;为抑制PolSAR图像中的散斑噪声,引入动态滤波器进行去噪;为促进多模态数据融合,设计基于交叉跳接连接的融合块,实现跨模态信息交互;融合特征经注意力机制优化后送入解码模块,通过多尺度卷积捕获多尺度信息。为辅助光学影像恢复,使用包含后向散射系数特征图与极化特征图的公开数据集OPT-BCFSAR-PFSAR。实验结果表明,该方法在定性与定量评估中均优于现有方法。

原文摘要 · Abstract (English)

Optical remote sensing images play a crucial role in the observation of the Earth's surface. However, obtaining complete optical remote sensing images is challenging due to cloud cover. Reconstructing cloud-free optical images has become a major task in recent years. This paper presents a two-flow Polarimetric Synthetic Aperture Radar (PolSAR)-Optical data fusion cloud removal algorithm (PODF-CR), which achieves the reconstruction of missing optical images. PODF-CR consists of an encoding module and a decoding module. The encoding module includes two parallel branches that extract PolSAR image features and optical image features. To address speckle noise in PolSAR images, we introduce dynamic filters in the PolSAR branch for image denoising. To better facilitate the fusion between multimodal optical images and PolSAR images, we propose fusion blocks based on cross-skip connections to enable interaction of multimodal data information. The obtained fusion features are refined through an attention mechanism to provide better conditions for the subsequent decoding of the fused images. In the decoding module, multi-scale convolution is introduced to obtain multi-scale information. Additionally, to better utilize comprehensive scattering information and polarization characteristics to assist in the restoration of optical images, we use a dataset for cloud restoration called OPT-BCFSAR-PFSAR, which includes backscatter coefficient feature images and polarization feature images obtained from PoLSAR data and optical images. Experimental results demonstrate that this method outperforms existing methods in both qualitative and quantitative evaluations.

遥感图像云去除多模态融合PolSAR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。