提出SADER框架,提升多时相遥感图像去云效率与结构保真度。
SADER: Structure-Aware Diffusion Framework with DEterministic Resampling for Multi-Temporal Remote Sensing Cloud Removal
- 设计多时相条件扩散网络,融合时序与模态信息增强表征。
- 在多个数据集上指标全面超越现有方法,峰值信噪比提升显著。
- 适合需要高精度去云的遥感应用,如环境监测与变化检测。
云污染严重降低遥感影像可用性,制约下游地球观测任务。近年来,基于扩散模型的方法因其强大的生成能力和稳定优化成为主流。然而,现有方法在多时相场景中采样效率有限,且未能充分挖掘结构与时间先验。本文提出SADER,一种面向多时相遥感去云的结构感知扩散框架。首先构建可扩展的多时相条件扩散网络(MTCDN),通过时序融合与混合注意力机制捕获多时相、多模态相关性;其次引入云感知注意力损失,考虑云层厚度与亮度差异,强化云区建模;此外,设计确定性重采样策略,通过引导修正替换异常样本,在固定采样步数下迭代优化生成结果。在多个多时相数据集上的实验表明,SADER在所有评估指标上均持续优于当前最优方法。代码已开源:https://github.com/zyfzs0/SADER。
原文摘要 · Abstract (English)
Cloud contamination severely degrades the usability of remote sensing imagery and poses a fundamental challenge for downstream Earth observation tasks. Recently, diffusion-based models have emerged as a dominant paradigm for remote sensing cloud removal due to their strong generative capability and stable optimization. However, existing diffusion-based approaches often suffer from limited sampling efficiency and insufficient exploitation of structural and temporal priors in multi-temporal remote sensing scenarios. In this work, we propose SADER, a structure-aware diffusion framework for multi-temporal remote sensing cloud removal. SADER first develops a scalable Multi-Temporal Conditional Diffusion Network (MTCDN) to fully capture multi-temporal and multimodal correlations via temporal fusion and hybrid attention. Then, a cloud-aware attention loss is introduced to emphasize cloud-dominated regions by accounting for cloud thickness and brightness discrepancies. In addition, a deterministic resampling strategy is designed for continuous diffusion models to iteratively refine samples under fixed sampling steps by replacing outliers through guided correction. Extensive experiments on multiple multi-temporal datasets demonstrate that SADER consistently outperforms state-of-the-art cloud removal methods across all evaluation metrics. The code of SADER is publicly available at https://github.com/zyfzs0/SADER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。