用信息瓶颈抑制雷达噪声,实现高保真光学云去除。
IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal

- 双流结构保留模态特征,融合时通过信息瓶颈压缩雷达噪声。
- 在SEN12MS-CR数据集上,结构与光谱保真度优于现有方法。
- 适合遥感图像去云、跨模态融合研究者参考。
合成孔径雷达(SAR)辅助的光学云去除旨在利用互补的SAR观测恢复被云遮挡的光学遥感图像地表信息。现有多模态融合方法通常依赖直接空间拼接和像素级监督,易将SAR斑点噪声传播至光学重建,导致结果过平滑。为此,本文提出信息瓶颈驱动的高保真网络(IB-HFN)。IB-HFN采用双流主干网络,在深度语义融合前保持模态特异性表示,缓解早期跨模态污染。融合阶段引入空间信息瓶颈融合模块,通过通道级变分信息瓶颈压缩SAR特征,抑制非结构化斑点噪声;同时设计局部-全局门控机制,预测无云区域并通过狄拉克初始化的跳跃连接传递可靠光学细节,实现噪声抑制与纹理保留解耦。进一步提出联合优化策略,整合特征级瓶颈正则化与图像级重建精度、结构一致性、光谱保真度及对比锐度约束,并采用动态权重调度平衡目标,稳定训练并减少雾状伪影。在具有挑战性的时空划分下的SEN12MS-CR数据集上的实验表明,IB-HFN在结构保持与光谱保真度方面均优于现有方法。
原文摘要 · Abstract (English)
Synthetic aperture radar (SAR)-assisted optical cloud removal aims to recover surface information obscured by clouds in optical remote sensing images by exploiting complementary SAR observations. Existing multimodal fusion methods typically rely on direct spatial concatenation and pixel-wise supervision, which can propagate SAR speckle noise into optical reconstruction and lead to over-smoothed results. To address these limitations, we propose an Information Bottleneck-driven High-Fidelity Network (IB-HFN) for SAR-assisted optical cloud removal. IB-HFN employs a dual-stream backbone to preserve modality-specific representations before deep semantic fusion, thereby mitigating premature cross-modal contamination. At the fusion stage, we introduce a Spatial Information Bottleneck Fusion module that compresses SAR features through a channel-wise variational information bottleneck to suppress unstructured speckle noise. In parallel, a local-global gating mechanism predicts clear-sky regions and routes reliable optical details through a Dirac-initialized skip connection, decoupling noise suppression from texture preservation. We further develop a joint optimization strategy that integrates feature-level bottleneck regularization with image-level constraints on reconstruction accuracy, structural consistency, spectral fidelity, and contrastive sharpness. A dynamic weighting schedule balances these objectives to stabilize training and reduce hazy artifacts. Experiments on the SEN12MS-CR dataset under challenging spatio-temporal splits demonstrate that IB-HFN achieves superior structural preservation and spectral fidelity over existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。