arXiv:2609.05303cs.CV2026-09

用隐式张量网络分两阶段提升高光谱图像超分辨率质量。

Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution

论文配图:Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution
图 1 · 摘自论文原文
  • 先学低秩张量表示,再用双源图像无监督校准互补信息。
  • 在多个数据集上达到领先性能,无需真实高分辨率标签。
  • 适合遥感图像重建与下游语义分割任务应用。

高光谱与多光谱图像融合(HMIF)旨在结合高分辨率多光谱图像(HR-MSI)的精细空间细节和低分辨率高光谱图像(LR-HSI)丰富的光谱信息,重建出高分辨率高光谱图像(HR-HSI)。近年来,隐式神经表示(INRs)为HMIF提供了灵活的基于坐标的建模能力,但现有方法难以充分捕捉细粒度空间结构与丰富的光谱依赖关系。此外,LR-HSI与HR-MSI主要通过退化一致性约束融合,其互补信息未被充分利用。为此,本文提出两阶段隐式张量神经表示框架(TSR-ITNR),统一集成表示精炼与观测引导校准。第一阶段,学习隐式Tucker表示,优化低秩空间系数张量与光谱基,以更好地捕获空间结构与波段间相关性;固定预训练去噪器提供深层先验用于初步重建。第二阶段,无参数校准从双源观测中提取互补且不干扰的修正项,恢复第一阶段遗漏的信息。理论分析证明了光谱精炼的保几何性与校准的正交互补性。大量实验表明,该方法在多个基准数据集上实现优异的定量、视觉与光谱重建效果,且无需真实HR-HSI监督。除常规重建指标外,还通过下游语义分割准确率进一步验证其有效性。

原文摘要 · Abstract (English)

Hyperspectral and multispectral image fusion (HMIF) aims to reconstruct a high-resolution hyperspectral image (HR-HSI) by combining the fine spatial details of a high-resolution multispectral image (HR-MSI) with the rich spectral information of a low-resolution hyperspectral image (LR-HSI). Recent advances in implicit neural representations (INRs) have enabled flexible coordinate-based modeling for HMIF; however, existing INR-based approaches may not fully capture fine-grained spatial structures and rich spectral dependencies. Moreover, the LR-HSI and HR-MSI are primarily incorporated through degradation-consistency constraints, leaving their complementary information underexploited. To address these limitations, we propose Two-Stage Reconstruction with Implicit Tensor Neural Representation (TSR-ITNR), a unified self-supervised framework integrating representation refinement and observation-guided calibration. In Stage 1, TSR-ITNR learns an implicit Tucker representation and refines its low-rank spatial coefficient tensor and spectral basis to better capture fine spatial structures and interband correlations. A fixed pretrained denoiser further provides a deep prior for the preliminary reconstruction. In Stage 2, parameter-free calibration derives complementary and noninterfering corrections from both observations to recover information insufficiently captured in Stage 1. Theoretical analysis establishes the geometry-preserving property of spectral refinement and the orthogonal complementarity of calibration. Extensive experiments on multiple benchmark datasets demonstrate strong quantitative, visual, and spectral reconstruction performance without ground-truth HR-HSI supervision. Beyond conventional reconstruction metrics, we further assess the effectiveness of TSR-ITNR using downstream semantic segmentation accuracy.

图像超分辨率高光谱成像隐式表示无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。