arXiv:2507.13339eess.IVcs.CV2025-07被引 2

无需真实高分辨率图像,用光谱响应函数实现无监督超分辨率重建

SpectraLift: Physics-Guided Spectral-Inversion Network for Self-Supervised Hyperspectral Image Super-Resolution

  • 基于光谱响应函数构建自监督网络,仅需低分辨多光谱图与高分辨多光谱图
  • 训练仅用1个损失函数,推理速度极快,分钟级收敛
  • 不依赖点扩散函数或真实标签,适合真实遥感场景

高空间分辨率的高光谱图像对遥感和医学成像至关重要,但传感器通常以牺牲空间细节换取光谱丰富性。将高空间分辨率多光谱图像(HR-MSI)与低空间分辨率高光谱图像(LR-HSI)融合,是恢复精细空间结构而不损失光谱保真的有效途径。现有主流方法需点扩散函数(PSF)校准或真实高分辨率高光谱图像(HR-HSI),在实际中难以获取。本文提出SpectraLift,一种完全自监督的框架,仅利用多光谱图像的光谱响应函数(SRF)融合LR-HSI与HR-MSI。SpectraLift通过合成低空间分辨率多光谱图(由LR-HSI经SRF处理得到)作为输入,以LR-HSI为输出,使用ℓ₁光谱重建损失进行训练,采用轻量级逐像素多层感知机(MLP)网络。推理时,该网络将HR-MSI逐像素映射为高分辨率高光谱估计。SpectraLift可在分钟内收敛,对空间模糊和分辨率无关,且在PSNR、SAM、SSIM和RMSE等指标上优于现有先进方法。

原文摘要 · Abstract (English)

High-spatial-resolution hyperspectral images (HSI) are essential for applications such as remote sensing and medical imaging, yet HSI sensors inherently trade spatial detail for spectral richness. Fusing high-spatial-resolution multispectral images (HR-MSI) with low-spatial-resolution hyperspectral images (LR-HSI) is a promising route to recover fine spatial structures without sacrificing spectral fidelity. Most state-of-the-art methods for HSI-MSI fusion demand point spread function (PSF) calibration or ground truth high resolution HSI (HR-HSI), both of which are impractical to obtain in real world settings. We present SpectraLift, a fully self-supervised framework that fuses LR-HSI and HR-MSI inputs using only the MSI's Spectral Response Function (SRF). SpectraLift trains a lightweight per-pixel multi-layer perceptron (MLP) network using ($i$)~a synthetic low-spatial-resolution multispectral image (LR-MSI) obtained by applying the SRF to the LR-HSI as input, ($ii$)~the LR-HSI as the output, and ($iii$)~an $\ell_1$ spectral reconstruction loss between the estimated and true LR-HSI as the optimization objective. At inference, SpectraLift uses the trained network to map the HR-MSI pixel-wise into a HR-HSI estimate. SpectraLift converges in minutes, is agnostic to spatial blur and resolution, and outperforms state-of-the-art methods on PSNR, SAM, SSIM, and RMSE benchmarks.

图像超分辨率高光谱成像自监督学习遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。