arXiv:2606.05759cs.CV2026-06

用物理引导的深度展开网络,解决多传感器间无监督光谱超分辨率问题。

Physics-Guided Deep Unfolding for Blind Cross-Sensor Spectral Super-Resolution via Learning the Spectral Transformation Function

  • 将优化过程展开为可训练的网络结构,同时学习图像和光谱退化函数
  • 在真实无人机数据上实现高精度重建,估计的退化函数与地物类型相关
  • 适合处理未知传感器间的光谱超分辨率,尤其适用于无人机遥感

高光谱成像提供丰富的定量遥感光谱信息,但高光谱传感器成本高,难以在许多无人机场景中部署。光谱超分辨率(SSR)旨在从多光谱图像(MSI)重建高光谱图像(HSI)。现有方法通常假设已知且固定的光谱响应函数(SRF),仅适用于单传感器场景。实际跨传感器情况下,从HSI到MSI的光谱退化未知且随传感器特性与场景内容变化,导致重建问题病态。本文提出一种物理引导的深度展开网络(PGU-Net),通过联合估计HSI和可学习的光谱变换函数(STF),解决盲跨传感器SSR问题。PGU-Net将交替优化过程展开为端到端可训练的分阶段架构,每阶段依次更新HSI和STF。两个模块结合可学习的近端网络与可微闭式求解器,在保持强表达能力的同时具备物理可解释性。在基准数据集(CAVE和NTIRE 2022)及多个SRF下实验表明,能准确恢复STF并优于当前最优方法。此外,在真实无人机跨传感器数据集(Headwall Nano HSI与DJI P4多光谱MSI)上的评估验证了PGU-Net在真正盲条件下的有效性和鲁棒性,提示估计的STF可能呈现地物覆盖相关差异。

原文摘要 · Abstract (English)

Hyperspectral imaging provides rich spectral information for quantitative remote sensing, yet hyperspectral sensors remain costly and thus unavailable in many UAV deployments. Spectral super-resolution (SSR) seeks to reconstruct hyperspectral images (HSIs) from multispectral images (MSIs). Most existing SSR methods assume a fixed and known spectral response function (SRF) and are therefore limited to single-sensor settings. In practical cross-sensor scenarios, the spectral degradation from HSI to MSI is unknown and varies with sensor characteristics and scene content, which renders HSI reconstruction ill-posed. This paper proposes a physics-guided deep unfolding network, termed PGU-Net, to address blind cross-sensor SSR by jointly estimating the HSI and a learnable spectral transformation function (STF). PGU-Net unrolls an alternating optimization procedure into an end-to-end trainable architecture with stages, where each stage sequentially updates the HSI and the STF. Both modules combine learnable proximal networks with differentiable closed-form solvers, enabling physical interpretability while retaining strong representation capacity. Experiments on benchmark datasets (CAVE and NTIRE 2022) with multiple SRFs demonstrate accurate recovery of the STF (degradation operator) and improved reconstruction performance over state-of-the-art SSR methods. Furthermore, evaluations on a real UAV cross-sensor dataset (Headwall Nano HSI and DJI P4 Multispectral MSI) verify the effectiveness and robustness of PGU-Net under truly blind conditions, and suggest that the estimated STF may exhibit land-cover-related differences.

光谱超分辨无人机遥感物理模型深度展开

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。