arXiv:2412.05696cs.CV2024-12被引 17

同时解决遥感图像模糊与超分辨难题,提升细节与分辨率。

Jointly RS Image Deblurring and Super-Resolution with Adjustable-Kernel and Multi-Domain Attention

  • 设计双分支网络,分别处理局部模糊与全局细节重建
  • 提出可调卷积核与多域注意力机制,精准建模退化特征
  • 适合遥感图像修复场景,尤其对复杂退化图像效果显著

遥感(RS)图像去模糊与超分辨是计算机视觉中恢复图像细节与空间尺度的常见任务。然而真实遥感图像常同时存在全局低分辨率与局部模糊退化。尽管去模糊与超分辨模型各自表现良好,但联合处理该任务仍面临重建全局与局部退化的关键矛盾。现有方法难以捕捉去模糊与超分辨过程间的关联,导致性能受限。为此,本文从理论上统一分析了遥感图像的空间与模糊退化过程,提出双分支并行网络AKMD-Net。该网络包含去模糊与超分辨两个分支:去模糊分支设计像素可调卷积核块(PAKB),用于估计局部空间变化的模糊核;超分辨分支引入多域注意力块(MDAB),增强高频细节的全局上下文感知。此外,通过自适应特征融合(AFF)模块建模两分支间关系,并设计自适应维纳损失(AW Loss)抑制重建图像中的先验噪声。大量实验表明,所提AKMD-Net在常用遥感图像数据集上达到先进水平。代码已公开于https://github.com/zpc456/AKMD-Net。

原文摘要 · Abstract (English)

Remote Sensing (RS) image deblurring and Super-Resolution (SR) are common tasks in computer vision that aim at restoring RS image detail and spatial scale, respectively. However, real-world RS images often suffer from a complex combination of global low-resolution (LR) degeneration and local blurring degeneration. Although carefully designed deblurring and SR models perform well on these two tasks individually, a unified model that performs jointly RS image deblurring and super-resolution (JRSIDSR) task is still challenging due to the vital dilemma of reconstructing the global and local degeneration simultaneously. Additionally, existing methods struggle to capture the interrelationship between deblurring and SR processes, leading to suboptimal results. To tackle these issues, we give a unified theoretical analysis of RS images' spatial and blur degeneration processes and propose a dual-branch parallel network named AKMD-Net for the JRSIDSR task. AKMD-Net consists of two main branches: deblurring and super-resolution branches. In the deblurring branch, we design a pixel-adjustable kernel block (PAKB) to estimate the local and spatial-varying blur kernels. In the SR branch, a multi-domain attention block (MDAB) is proposed to capture the global contextual information enhanced with high-frequency details. Furthermore, we develop an adaptive feature fusion (AFF) module to model the contextual relationships between the deblurring and SR branches. Finally, we design an adaptive Wiener loss (AW Loss) to depress the prior noise in the reconstructed images. Extensive experiments demonstrate that the proposed AKMD-Net achieves state-of-the-art (SOTA) quantitative and qualitative performance on commonly used RS image datasets. The source code is publicly available at https://github.com/zpc456/AKMD-Net.

遥感图像去模糊超分辨多域注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。