提出新型网络提升高光谱图像融合质量与效率
HSSDCT: Factorized Spatial-Spectral Correlation for Hyperspectral Image Fusion
- 分层密集残差变换块增强多尺度特征提取
- 空间光谱相关层将自注意力复杂度降至线性
- 在多个数据集上实现最优效果且计算开销低
高光谱图像(HSI)融合旨在结合低分辨率高光谱图像(LR-HSI)的丰富光谱信息与高分辨率多光谱图像(HR-MSI)的精细空间细节,重建高分辨率高光谱图像(HR-HSI)。尽管近期深度学习方法取得显著进展,但仍受限于感受野有限、光谱波段冗余以及自注意力机制的二次复杂度,影响效率与鲁棒性。为此,本文提出层级空间-光谱稠密相关网络(HSSDCT),包含两个核心模块:(i) 分层稠密残差变换块(HDRTB),通过逐步扩大窗口并引入稠密残差连接实现多尺度特征聚合;(ii) 空间-光谱相关层(SSCL),显式分解空间与光谱依赖关系,将自注意力降为线性复杂度,缓解光谱冗余问题。在基准数据集上的大量实验表明,HSSDCT 在保持极低计算成本的同时实现了更优的重建质量,达到高光谱图像融合新纪录。代码已公开于 https://github.com/jemmyleee/HSSDCT。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) fusion aims to reconstruct a high-resolution HSI (HR-HSI) by combining the rich spectral information of a low-resolution HSI (LR-HSI) with the fine spatial details of a high-resolution multispectral image (HR-MSI). Although recent deep learning methods have achieved notable progress, they still suffer from limited receptive fields, redundant spectral bands, and the quadratic complexity of self-attention, which restrict both efficiency and robustness. To overcome these challenges, we propose the Hierarchical Spatial-Spectral Dense Correlation Network (HSSDCT). The framework introduces two key modules: (i) a Hierarchical Dense-Residue Transformer Block (HDRTB) that progressively enlarges windows and employs dense-residue connections for multi-scale feature aggregation, and (ii) a Spatial-Spectral Correlation Layer (SSCL) that explicitly factorizes spatial and spectral dependencies, reducing self-attention to linear complexity while mitigating spectral redundancy. Extensive experiments on benchmark datasets demonstrate that HSSDCT delivers superior reconstruction quality with significantly lower computational costs, achieving new state-of-the-art performance in HSI fusion. Our code is available at https://github.com/jemmyleee/HSSDCT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。