用新型神经网络融合多光谱与低分辨率高光谱图,提升图像清晰度。
HSR-KAN: Efficient Hyperspectral Image Super-Resolution via Kolmogorov-Arnold Networks
- 基于柯尔莫戈洛夫-阿诺德网络设计融合模块,精准整合空间信息。
- 在多个数据集上优于现有方法,峰值信噪比最高提升0.38dB。
- 适合需要高精度光谱图像的遥感、医学成像等场景。
高光谱图像(HSIs)因丰富的光谱信息在各类视觉任务中具有巨大潜力,但受物理成像限制,获取高分辨率高光谱图像仍具挑战。受柯尔莫戈洛夫-阿诺德网络(KANs)启发,本文提出一种高效的高光谱图像超分辨率模型(HSR-KAN),通过融合低分辨率高光谱图像(LR-HSI)与高分辨率多光谱图像(HR-MSI),生成高分辨率高光谱图像(HR-HSI)。为有效整合来自HR-MSI的空间信息,设计基于KANs的融合模块(KAN-Fusion)。进一步受通道注意力机制启发,提出集成KAN的光谱通道注意力模块(KAN-CAB),用于融合后特征提取。该模块不仅增强网络对光谱序列和空间纹理细节的精细调节能力,还能有效缓解维度诅咒问题。大量实验表明,相比当前最先进的HSI-SR方法,所提方法在定性与定量评估上均取得最优表现。代码已公开于:https://github.com/Baisonm-Li/HSR-KAN。
原文摘要 · Abstract (English)
Hyperspectral images (HSIs) have great potential in various visual tasks due to their rich spectral information. However, obtaining high-resolution hyperspectral images remains challenging due to limitations of physical imaging. Inspired by Kolmogorov-Arnold Networks (KANs), we propose an efficient HSI super-resolution (HSI-SR) model to fuse a low-resolution HSI (LR-HSI) and a high-resolution multispectral image (HR-MSI), yielding a high-resolution HSI (HR-HSI). To achieve the effective integration of spatial information from HR-MSI, we design a fusion module based on KANs, called KAN-Fusion. Further inspired by the channel attention mechanism, we design a spectral channel attention module called KAN Channel Attention Block (KAN-CAB) for post-fusion feature extraction. As a channel attention module integrated with KANs, KAN-CAB not only enhances the fine-grained adjustment ability of deep networks, enabling networks to accurately simulate details of spectral sequences and spatial textures, but also effectively avoid Curse of Dimensionality. Extensive experiments show that, compared to current state-of-the-art HSI-SR methods, proposed HSR-KAN achieves the best performance in terms of both qualitative and quantitative assessments. Our code is available at: https://github.com/Baisonm-Li/HSR-KAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。