arXiv:2501.18664eess.IVcs.AI2025-01被引 6

提出轻量级超光谱图像超分辨网络,显著提升速度且保持精度。

Rethinking the Upsampling Layer in Hyperspectral Image Super Resolution

  • 引入通道注意力与低秩近似优化上采样层,减少参数冗余。
  • 在多个数据集上实现数十至数百倍加速,性能媲美先进方法。
  • 适合需要实时处理的超光谱图像应用,如遥感监测。

深度学习在单幅超光谱图像超分辨(SHSR)任务中取得显著进展;然而,高光谱维度带来的巨大计算负担使其难以部署于实时场景。为此,本文提出一种新型轻量级SHSR网络LKCA-Net,通过通道注意力校准多尺度通道特征。此外,首次揭示可学习上采样层的低秩特性是轻量级SHSR方法的关键瓶颈。为此,采用低秩近似策略优化其参数冗余。同时,引入基于知识蒸馏的特征对齐技术,确保低秩近似网络保留原始网络的特征表示能力。在Chikusei、Houston 2018和Pavia Center数据集上的大量实验表明,该方法在性能上具有竞争力,同时相比其他高性能SHSR方法实现数十至数百倍的加速。

原文摘要 · Abstract (English)

Deep learning has achieved significant success in single hyperspectral image super-resolution (SHSR); however, the high spectral dimensionality leads to a heavy computational burden, thus making it difficult to deploy in real-time scenarios. To address this issue, this paper proposes a novel lightweight SHSR network, i.e., LKCA-Net, that incorporates channel attention to calibrate multi-scale channel features of hyperspectral images. Furthermore, we demonstrate, for the first time, that the low-rank property of the learnable upsampling layer is a key bottleneck in lightweight SHSR methods. To address this, we employ the low-rank approximation strategy to optimize the parameter redundancy of the learnable upsampling layer. Additionally, we introduce a knowledge distillation-based feature alignment technique to ensure the low-rank approximated network retains the same feature representation capacity as the original. We conducted extensive experiments on the Chikusei, Houston 2018, and Pavia Center datasets compared to some SOTAs. The results demonstrate that our method is competitive in performance while achieving speedups of several dozen to even hundreds of times compared to other well-performing SHSR methods.

超光谱超分辨轻量化低秩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。