融合全色图实现高光谱图像去噪与超分辨率,一步到位提升画质。
Hipandas: Hyperspectral Image Joint Denoising and Super-Resolution by Image Fusion with the Panchromatic Image
- 通过联合建模去噪与超分任务,避免误差累积。
- 在真实和模拟数据上均超越现有方法,生成更清晰的高分辨率图像。
- 适合遥感图像处理、环境监测等需要高质量高光谱数据的领域。
高光谱图像(HSI)常因成像设备限制而存在噪声且分辨率低。近年来发射的卫星可同步获取高光谱图像(HSI)与全色图像(PAN),为通过融合全色图实现去噪与超分辨率提供了可能。然而,以往研究将两项任务独立处理,导致误差累积。本文提出一种新的学习范式 Hipandas,从噪声低分辨率高光谱图像(LRHS)与高分辨率全色图像中重建出高分辨率高光谱图像(HRHS)。所提零样本框架包含引导去噪网络、引导超分辨率网络与全色图像重建网络,利用高光谱图像低秩先验及新提出的细节导向低秩先验。各网络间相互耦合,训练过程复杂,需采用两阶段训练策略以确保有效训练。在模拟与真实数据集上的实验结果表明,该方法显著优于当前最先进算法,生成的高分辨率高光谱图像在精度与视觉效果上均有提升。
原文摘要 · Abstract (English)
Hyperspectral images (HSIs) are frequently noisy and of low resolution due to the constraints of imaging devices. Recently launched satellites can concurrently acquire HSIs and panchromatic (PAN) images, enabling the restoration of HSIs to generate clean and high-resolution imagery through fusing PAN images for denoising and super-resolution. However, previous studies treated these two tasks as independent processes, resulting in accumulated errors. This paper introduces \textbf{H}yperspectral \textbf{I}mage Joint \textbf{Pand}enoising \textbf{a}nd Pan\textbf{s}harpening (Hipandas), a novel learning paradigm that reconstructs HRHS images from noisy low-resolution HSIs (LRHS) and high-resolution PAN images. The proposed zero-shot Hipandas framework consists of a guided denoising network, a guided super-resolution network, and a PAN reconstruction network, utilizing an HSI low-rank prior and a newly introduced detail-oriented low-rank prior. The interconnection of these networks complicates the training process, necessitating a two-stage training strategy to ensure effective training. Experimental results on both simulated and real-world datasets indicate that the proposed method surpasses state-of-the-art algorithms, yielding more accurate and visually pleasing HRHS images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。