无需真实高分辨率数据,用合成丰度图实现高光谱图像无监督超分辨。
Synthetic Abundance Maps for Unsupervised Super-Resolution of Hyperspectral Remote Sensing Images
- 用类树叶模型生成与传感器特性匹配的合成丰度图用于训练。
- 在3个数据集、3种缩放因子下均实现有效超分辨,性能优于现有方法。
- 适合缺乏真实标注数据的高光谱遥感场景,尤其适用于无监督学习研究者。
高光谱单图像超分辨率(HS-SISR)旨在提升高光谱图像的空间分辨率以充分挖掘其光谱信息。尽管该领域已取得显著进展,但多数方法为有监督学习,依赖高分辨率真实数据进行训练——而这类数据在实际中往往不可得。为此,本文提出一种基于合成丰度数据的新型无监督训练框架,无需高分辨率真值即可训练。首先将高光谱图像分解为端元和丰度图,再利用一个神经网络仅通过合成丰度图进行丰度超分辨率训练。这些合成丰度图由类树叶模型生成,其特征源自待处理的低分辨率图像及已知的高光谱传感器点扩散函数(PSF)。训练完成后,用该网络增强原始图像的丰度图,并结合端元重建最终的超分辨率高光谱图像。实验在3个数据集、3种缩放因子及多个评估指标下验证了合成数据的训练价值与方法的有效性。代码开源:https://github.com/xinxinxu99/SISR-DL.git
原文摘要 · Abstract (English)
Hyperspectral single image super-resolution (HS-SISR) aims to enhance the spatial resolution of hyperspectral images to fully exploit their spectral information. While considerable progress has been made in this field, most existing methods are supervised and require ground truth data for training-data that is often unavailable in practice. To overcome this limitation, we propose a novel unsupervised training framework for HS-SISR, based on synthetic abundance data, where no high-resolution ground-truth reference is required for training. The approach begins by unmixing the hyperspectral image into endmembers and abundances. A neural network is then trained to perform abundance super-resolution using synthetic abundances only. These synthetic abundance maps are generated from a dead leaves model whose characteristics are inherited from the low-resolution image to be super-resolved and from the known point spread function (PSF) of the hyperspectral sensor. This trained network is subsequently used to enhance the spatial resolution of the original image's abundances, and the final super-resolution hyperspectral image is reconstructed by combining them with the endmembers. Experimental results demonstrate both the training value of the synthetic data and the effectiveness of the proposed method across 3 datasets, 3 scaling factors, and several evaluation metrics. The code is available at https://github.com/xinxinxu99/SISR-DL.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。