用物理规律生成逼真云图,提升遥感数据质量。
PGCS: Physical Law embedded Generative Cloud Synthesis in Remote Sensing Images
- 结合风格迁移GAN与大气散射定律,分空间与光谱两阶段生成云图。
- 生成云图在多波段上与真实数据相似度高,优于三种现有方法。
- 适用于多种传感器数据,可提升云校正、分类等任务性能。
遥感数据的数量与质量对信息提取至关重要,但当前数据集常因云层影响而受限,降低数据可用性并影响数据驱动类算法的精度。本文提出一种嵌入物理规律的生成式云合成方法(PGCS),通过生成多样且真实的云图像来增强真实数据,支持云校正、检测及分类、识别、分割等任务的数据增广。PGCS包含两个关键阶段:空间合成阶段采用基于风格的生成对抗网络模拟云的空间特征,生成单通道云图;光谱合成阶段通过局部统计与全局拟合方法嵌入大气散射定律,将单通道云转为多光谱云。实验表明,PGCS在两阶段均表现高精度,优于三种现有云合成方法。基于PGCS开发的两种云校正方法,在云校正任务中显著优于现有最优方法。此外,该方法成功扩展至多种传感器数据。代码将公开于https://github.com/Liying-Xu/PGCS。
原文摘要 · Abstract (English)
Data quantity and quality are both critical for information extraction and analyzation in remote sensing. However, the current remote sensing datasets often fail to meet these two requirements, for which cloud is a primary factor degrading the data quantity and quality. This limitation affects the precision of results in remote sensing application, particularly those derived from data-driven techniques. In this paper, a physical law embedded generative cloud synthesis method (PGCS) is proposed to generate diverse realistic cloud images to enhance real data and promote the development of algorithms for subsequent tasks, such as cloud correction, cloud detection, and data augmentation for classification, recognition, and segmentation. The PGCS method involves two key phases: spatial synthesis and spectral synthesis. In the spatial synthesis phase, a style-based generative adversarial network is utilized to simulate the spatial characteristics, generating an infinite number of single-channel clouds. In the spectral synthesis phase, the atmospheric scattering law is embedded through a local statistics and global fitting method, converting the single-channel clouds into multi-spectral clouds. The experimental results demonstrate that PGCS achieves a high accuracy in both phases and performs better than three other existing cloud synthesis methods. Two cloud correction methods are developed from PGCS and exhibits a superior performance compared to state-of-the-art methods in the cloud correction task. Furthermore, the application of PGCS with data from various sensors was investigated and successfully extended. Code will be provided at https://github.com/Liying-Xu/PGCS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。