arXiv:2603.00920eess.IV2026-03中稿 · CVPR被引 3

用AI把卫星图像从12波段升维到186波段,实现全球高光谱覆盖。

Spectral Super-Resolution via Adversarial Unfolding and Data-Driven Spectrum Regularization: From Multispectral Satellite Data to NASA Hyperspectral Image

  • 设计新型对抗性展开网络,融合数据驱动光谱先验
  • 重建后达到186波段,空间分辨率统一至5米,性能超越主流Transformer
  • 模型参数少20倍、计算量仅15%,适合实际部署

欧洲航天局的哨兵-2卫星为遥感应用提供全球多光谱覆盖,但其光谱分辨率有限(12波段)且空间分辨率不统一(60/20/10米),限制了实际应用。相比之下,美国宇航局的AVIRIS-NG等高光谱-空间分辨率传感器仅覆盖北美地区。这引发一个核心问题:能否通过重建哨兵-2数据,生成类似NASA的高光谱图像,实现全球覆盖?本研究旨在将12波段数据提升至186波段,并统一空间分辨率至5米。为此,提出一种基于先验网络(PriorNet)数据驱动光谱先验的深度展开框架,取代传统隐式深度先验。同时,在展开结构中引入对抗项,使判别器在训练和测试阶段均指导重建过程,提出“对抗性展开学习”(UAL)。实验表明,所提方法在PSNR、SSIM、SAM上均优于现有最优的Transformer模型,且仅需15%的乘加操作(MACs)与20倍更少的参数。相关代码将在https://sites.google.com/view/chiahsianglin/software公开。

原文摘要 · Abstract (English)

The European Space Agency's Sentinel-2 satellite provides global multispectral coverage for remote sensing (RS) applications. However, limited spectral resolution (12 bands) and non-unified spatial resolution (60/20/10 m) restrict their practicality. In contrast, the high spectral-spatial resolution sensor (e.g., NASA's AVIRIS-NG) covers only the American region due to practical considerations. This raises a fundamental question: ``Can a global hyperspectral coverage be achieved by reconstructing Sentinel-2 data to NASA hyperspectral images?'' This study aims to achieve spectral super-resolution from 12-to-186 and unify the spatial resolution of Sentinel-2 data to 5 m. To enable a reliable and efficient reconstruction, we formulate a novel deep unfolding framework regularized by a data-driven spectrum prior from PriorNet, instead of relying on implicit deep priors as conventional deep unfolding does. Moreover, an adversarial term is integrated into the unfolded architecture, enabling the discriminator to guide the reconstruction in both the training and testing phases; we term this novel concept unfolding adversarial learning (UAL). Experiments show that our UALNet outperforms the next-best Transformer in PSNR, SSIM, and SAM, while requiring only 15% MACs and 20 times fewer parameters. The associated code will be publicly available at https://sites.google.com/view/chiahsianglin/software.

光谱超分辨率遥感图像对抗展开多源融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。