用统一分布策略让遥感图像融合模型跨传感器通用
Enpowering Your Pansharpening Models with Generalizability: Unified Distribution is All You Need
- 构建像素分布转换函数,使不同卫星数据归一到相同分布
- 在多个传感器上测试,提升模型泛化能力,实现一次训练永久部署
- 适合需要跨平台应用的遥感图像处理研究者
基于深度学习的遥感图像全色锐化模型在训练数据上表现优异,但因传感器特性和成像条件差异,面对未见卫星数据时性能显著下降,泛化能力不足。本文认为性能退化主要源于源间分布差异,核心在于弥合训练与测试分布的鸿沟。为此提出统一分布策略(UniPAN),通过构建分布变换函数,将来自不同来源的像素映射至一致分布。模型在变换后的域中训练,测试时新数据也经相同变换以匹配训练分布。该方法使模型始终在统一分布下训练与测试,显著增强泛化能力。大量实验验证了其有效性,可在多种卫星传感器上大幅提升深度模型性能。代码已开源。
原文摘要 · Abstract (English)
Existing deep learning-based models for remote sensing pansharpening exhibit exceptional performance on training datasets. However, due to sensor-specific characteristics and varying imaging conditions, these models suffer from substantial performance degradation when applied to unseen satellite data, lacking generalizability and thus limiting their applicability. We argue that the performance drops stem primarily from distributional discrepancies from different sources and the key to addressing this challenge lies in bridging the gap between training and testing distributions. To validate the idea and further achieve a "train once, deploy forever" capability, this paper introduces a novel and intuitive approach to enpower any pansharpening models with generalizability by employing a unified distribution strategy (UniPAN). Specifically, we construct a distribution transformation function that normalizes the pixels sampled from different sources to conform to an identical distribution. The deep models are trained on the transformed domain, and during testing on new datasets, the new data are also transformed to match the training distribution. UniPAN aims to train and test the model on a unified and consistent distribution, thereby enhancing its generalizability. Extensive experiments validate the efficacy of UniPAN, demonstrating its potential to significantly enhance the performance of deep pansharpening models across diverse satellite sensors. Codes: https://github.com/yc-cui/UniPAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。