arXiv:2510.20814cs.CV2025-10被引 2

用结构化隐空间实现可解释的高光谱超分辨率,无需标签也稳定高效。

SpectraMorph: Structured Latent Learning for Self-Supervised Hyperspectral Super-Resolution

  • 通过解混瓶颈将低分辨率高光谱图提取端元,再由多层感知机从多光谱图预测丰度图
  • 在合成与真实数据上均超越现有自监督方法,单波段多光谱输入仍保持鲁棒性
  • 训练快(<1分钟)、结果可解释,适合缺乏标注数据的遥感应用

高光谱传感器每像素捕捉密集光谱,但空间分辨率低,导致边界模糊和混合像元问题。共配准的多光谱、RGB或全色相机提供高分辨率空间细节,推动了高光谱与多光谱图像融合的超分辨率研究(HSI-MSI)。现有深度学习方法虽性能强,但依赖不可解释的回归器,当多光谱图像波段极少时易失效。本文提出SpectraMorph,一种基于物理引导的自监督融合框架,具备结构化隐空间。不直接回归,而是强制解混瓶颈:从低分辨率高光谱图中提取端元,再用紧凑的多层感知机从多光谱图预测类似丰度的映射;光谱通过线性混合重建,训练通过多光谱传感器的光谱响应函数实现自监督。SpectraMorph生成可解释中间结果,训练耗时不足一分钟,即使仅使用单波段(全色)多光谱输入仍保持稳健。在合成与真实数据集上的实验表明,SpectraMorph持续优于最先进的无监督/自监督基线,且与有监督基线相当。

原文摘要 · Abstract (English)

Hyperspectral sensors capture dense spectra per pixel but suffer from low spatial resolution, causing blurred boundaries and mixed-pixel effects. Co-registered companion sensors such as multispectral, RGB, or panchromatic cameras provide high-resolution spatial detail, motivating hyperspectral super-resolution through the fusion of hyperspectral and multispectral images (HSI-MSI). Existing deep learning based methods achieve strong performance but rely on opaque regressors that lack interpretability and often fail when the MSI has very few bands. We propose SpectraMorph, a physics-guided self-supervised fusion framework with a structured latent space. Instead of direct regression, SpectraMorph enforces an unmixing bottleneck: endmember signatures are extracted from the low-resolution HSI, and a compact multilayer perceptron predicts abundance-like maps from the MSI. Spectra are reconstructed by linear mixing, with training performed in a self-supervised manner via the MSI sensor's spectral response function. SpectraMorph produces interpretable intermediates, trains in under a minute, and remains robust even with a single-band (pan-chromatic) MSI. Experiments on synthetic and real-world datasets show SpectraMorph consistently outperforming state-of-the-art unsupervised/self-supervised baselines while remaining very competitive against supervised baselines.

高光谱超分辨率自监督解混

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。