提出S³RNet框架,用稀疏表示提升高光谱图像融合质量。
Robust Hyperspectral Image Panshapring via Sparse Spatial-Spectral Representation
- 通过多分支融合网络捕获多尺度空间-光谱特征
- 在噪声环境下仍保持高重建质量,优于现有方法
- 适合遥感图像处理与高光谱数据增强研究者
高分辨率高光谱成像在遥感应用中至关重要,但受硬件限制难以获取。本文提出S³RNet框架,通过稀疏空间-光谱表示,将低分辨率高光谱图像(LRHSI)与高分辨率多光谱图像(HRMSI)融合。核心为多分支融合网络(MBFN),采用并行分支捕捉不同空间与光谱尺度的互补特征。提出的空间-光谱注意力加权块(SSAWB)动态调整特征权重,在保持稀疏性的同时抑制噪声与冗余。引入密集特征聚合块(DFAB),通过密集连接模式高效聚合特征。该设计使S³RNet能选择性强化多尺度信息,同时保持计算效率。大量实验表明,S³RNet在多个评价指标上达到领先性能,尤其在噪声挑战下仍保持优异重建质量。代码将公开。
原文摘要 · Abstract (English)
High-resolution hyperspectral imaging plays a crucial role in various remote sensing applications, yet its acquisition often faces fundamental limitations due to hardware constraints. This paper introduces S$^{3}$RNet, a novel framework for hyperspectral image pansharpening that effectively combines low-resolution hyperspectral images (LRHSI) with high-resolution multispectral images (HRMSI) through sparse spatial-spectral representation. The core of S$^{3}$RNet is the Multi-Branch Fusion Network (MBFN), which employs parallel branches to capture complementary features at different spatial and spectral scales. Unlike traditional approaches that treat all features equally, our Spatial-Spectral Attention Weight Block (SSAWB) dynamically adjusts feature weights to maintain sparse representation while suppressing noise and redundancy. To enhance feature propagation, we incorporate the Dense Feature Aggregation Block (DFAB), which efficiently aggregates inputted features through dense connectivity patterns. This integrated design enables S$^{3}$RNet to selectively emphasize the most informative features from differnt scale while maintaining computational efficiency. Comprehensive experiments demonstrate that S$^{3}$RNet achieves state-of-the-art performance across multiple evaluation metrics, showing particular strength in maintaining high reconstruction quality even under challenging noise conditions. The code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。