将哨兵2号影像快速超分辨为高光谱图像,提升物质识别能力
ExplainS2A: Explainable Spectral-Spatial Duality Model for Fast Transforming Sentinel-2 Image to AVIRIS-Level Hyperspectral Image

- 利用光谱-空间对偶理论,将超分辨问题转为可解释的融合框架
- 1秒内处理百万像素哨兵2号图像,生成高保真高光谱图像
- 适用于多种传感器组合,具备跨区域跨季节泛化能力
主流光学卫星多获取多光谱多分辨率影像,其材料识别能力远低于高光谱影像(HSI)。因此,将多光谱影像(MSI)超分辨为高光谱影像可显著提升遥感物质识别及下游任务效果。然而,由于传感器存在低分辨率波段,传统方法常导致重建结果空间模糊,生成低分辨率高光谱影像。为此,本文利用多光谱影像中固有的高分辨率波段作为空间引导,融合重建过程,实现高分辨率高光谱影像生成。该融合机制与卫星遥感中的空间超分辨问题高度一致,从而提出光谱-空间对偶理论,将复杂的光谱超分辨重构为更易处理的空间超分辨问题。据此,我们设计ExplainS2A模型,包含深度展开网络与可解释融合网络,统一实现光谱恢复与空间融合,具备线性时间复杂度,无需黑箱推理。实验表明,ExplainS2A可在1秒内处理百万级哨兵2号影像,生成高质量高光谱影像,显著提升盲源分离性能。该框架不仅在哨兵2号与AVIRIS间验证,还可推广至多种分辨率配置的传感器对,并表现出跨区域、跨季节泛化能力。
原文摘要 · Abstract (English)
Mainstream optical satellites often acquire multispectral multi-resolution images, which have limited material identifiability compared to the HSIs. Thus, spectrally super-resolving the MSI into their hyperspectral counterparts greatly facilitates remote material identification and the downstream tasks. However, spectrally super-resolving the MSI into an HSI is often constrained by the multi-resolution nature of the sensor. Specifically, due to the presence of some LR bands in the MSI, the initial spectral super-resolution results often appear to be spatially blurry, resulting in an LR HSI. To overcome this bottleneck, we then leverage some HR band inherent in the acquired MSI to spatially guide the reconstruction procedure, thereby yielding the desired HR HSI. This fusion procedure elegantly coincides with a widely known spatial super-resolution problem in satellite remote sensing. Hence, we have reformulated the tough spectral super-resolution problem into a more widely investigated spatial super-resolution problem, referred to as the spectral-spatial duality theory. Accordingly, we propose ExplainS2A, consisting of a deep unfolding network and an explainable fusion network, that unifies spectral recovery and spatial fusion into a single explainable framework. Unlike conventional black-box models, ExplainS2A offers interpretability and operates as a linear-time algorithm. Remarkably, it can process a million-scale Sentinel-2 image in less than one second, yielding high-fidelity HSI over the same scene, and upgrades the blind source separation results. Although demonstrated on the Sentinel-2 and AVIRIS sensors, ExplainS2A also serves as a general framework applicable to various sensor pairs with different resolution configurations, and has experimentally demonstrated cross-region and cross-season generalization ability. Source codes: https://github.com/IHCLab/ExplainS2A.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。