提升遥感多图超分中的空间相关性,重建更清晰的高分辨率图像。
ESC-MISR: Enhancing Spatial Correlations for Multi-Image Super-Resolution in Remote Sensing
- 设计新型空间变换模块,增强多幅低分辨率图之间的空间关联。
- 在PROBA-V数据集上,双波段分别提升0.70dB和0.76dB的cPSNR。
- 适合关注遥感图像重建与空间特征挖掘的研究者。
多图超分辨率(MISR)是遥感领域的重要但具挑战性的任务。本文针对遥感多图超分辨率(MISR-RS)问题,旨在从卫星获取的多幅低分辨率(LR)图像中生成高分辨率(HR)图像。近期,低分辨率图像间的弱时序相关性受到越来越多关注。然而,现有方法将低分辨率图像视为具有强时序依赖的序列,忽视了空间相关性并引入不必要的时序假设。为此,本文提出端到端的新框架ESC-MISR,充分挖掘多图像间的时空关系以实现高质量的高分辨率图像重建。具体而言,首次引入多图空间变换模块(MIST),突出具有更清晰全局空间特征的区域,强化低分辨率图像间空间关联;同时,在训练阶段对输入序列进行随机打乱,削弱时序依赖,捕捉弱时序相关性。相较于当前最优方法,本方法在PROBA-V数据集两个波段上分别取得0.70dB和0.76dB的cPSNR提升,验证了其优越性。
原文摘要 · Abstract (English)
Multi-Image Super-Resolution (MISR) is a crucial yet challenging research task in the remote sensing community. In this paper, we address the challenging task of Multi-Image Super-Resolution in Remote Sensing (MISR-RS), aiming to generate a High-Resolution (HR) image from multiple Low-Resolution (LR) images obtained by satellites. Recently, the weak temporal correlations among LR images have attracted increasing attention in the MISR-RS task. However, existing MISR methods treat the LR images as sequences with strong temporal correlations, overlooking spatial correlations and imposing temporal dependencies. To address this problem, we propose a novel end-to-end framework named Enhancing Spatial Correlations in MISR (ESC-MISR), which fully exploits the spatial-temporal relations of multiple images for HR image reconstruction. Specifically, we first introduce a novel fusion module named Multi-Image Spatial Transformer (MIST), which emphasizes parts with clearer global spatial features and enhances the spatial correlations between LR images. Besides, we perform a random shuffle strategy for the sequential inputs of LR images to attenuate temporal dependencies and capture weak temporal correlations in the training stage. Compared with the state-of-the-art methods, our ESC-MISR achieves 0.70dB and 0.76dB cPSNR improvements on the two bands of the PROBA-V dataset respectively, demonstrating the superiority of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。