arXiv:2501.01460eess.IVcs.CV2025-01被引 2

提出GDSR模型,实现遥感图像超分辨率中全局与局部特征的协同重建。

GDSR: Global-Detail Integration through Dual-Branch Network with Wavelet Losses for Remote Sensing Image Super-Resolution

  • 设计双分支结构并行处理全局(RWKV)与局部(卷积)特征。
  • 在多个数据集上比顶尖Transformer模型提升0.09 dB PSNR,参数减少37%。
  • 适合需要高效高保真遥感图像重建的应用场景。

近年来,深度神经网络在遥感图像超分辨率(RSI-SR)任务中取得显著进展。然而,现有方法通常忽视全局与局部依赖之间的互补关系,或侧重捕捉局部信息,或优先建模全局结构,导致难以同时有效提取两类特征。此外,其计算开销在大规模遥感图像上变得不可接受。为此,本文首次将受体加权键值(RWKV)应用于RSI-SR,以线性复杂度捕获长程依赖。为同时建模全局与局部特征,提出全局-细节双分支结构GDSR,通过并行处理RWKV与卷积操作来应对大尺度遥感图像。进一步引入全局-细节重建模块(GDRM),作为两分支间的桥梁以融合互补信息。此外,提出双组多尺度小波损失,基于双组子带策略与跨分辨率频率对齐,在小波域增强重建保真度。在AID、UCMerced和RSSRD-QH等多个基准数据集上,采用两种退化方式的大量实验表明,GDSR相比最先进基于Transformer的方法HAT平均提升0.09 dB PSNR,仅需其63%参数量与51%浮点运算量,推理速度提升3.2倍。

原文摘要 · Abstract (English)

In recent years, deep neural networks, including Convolutional Neural Networks, Transformers, and State Space Models, have achieved significant progress in Remote Sensing Image (RSI) Super-Resolution (SR). However, existing SR methods typically overlook the complementary relationship between global and local dependencies. These methods either focus on capturing local information or prioritize global information, which results in models that are unable to effectively capture both global and local features simultaneously. Moreover, their computational cost becomes prohibitive when applied to large-scale RSIs. To address these challenges, we introduce the novel application of Receptance Weighted Key Value (RWKV) to RSI-SR, which captures long-range dependencies with linear complexity. To simultaneously model global and local features, we propose the Global-Detail dual-branch structure, GDSR, which performs SR by paralleling RWKV and convolutional operations to handle large-scale RSIs. Furthermore, we introduce the Global-Detail Reconstruction Module (GDRM) as an intermediary between the two branches to bridge their complementary roles. In addition, we propose the Dual-Group Multi-Scale Wavelet Loss, a wavelet-domain constraint mechanism via dual-group subband strategy and cross-resolution frequency alignment for enhanced reconstruction fidelity in RSI-SR. Extensive experiments under two degradation methods on several benchmarks, including AID, UCMerced, and RSSRD-QH, demonstrate that GSDR outperforms the state-of-the-art Transformer-based method HAT by an average of 0.09 dB in PSNR, while using only 63% of its parameters and 51% of its FLOPs, achieving an inference speed 3.2 times faster.

遥感图像超分辨率双分支网络小波损失

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。