arXiv:2412.09841cs.CVeess.IV2024-12被引 11

融合深度学习与变分模型,提升遥感图像超分辨率质量

Super-Resolution for Remote Sensing Imagery via the Coupling of a Variational Model and Deep Learning

  • 用深度网络提取梯度先验,结合变分优化重建图像
  • 在多个数据集上达到优于现有方法的峰值信噪比和结构相似性
  • 适合需要高精度遥感图像的地理信息与环境监测应用

图像超分辨率(SR)是提升遥感图像空间分辨率和细节信息的有效手段,可获得更优的视觉质量。由于SR问题严重不适定,需引入有效的图像先验来约束解空间并生成高分辨率(HR)图像。本文提出一种新颖的梯度引导多帧超分辨率(MFSR)框架,将学习到的梯度先验作为正则项嵌入基于模型的优化方法中。具体地,局部梯度正则化(LGR)先验通过深度残差注意力网络(DRAN)的梯度特征转换获得;非局部总变差(NLTV)先验则基于梯度块的空间结构相似性,结合最大后验(MAP)模型刻画。所建模的先验在保持边缘平滑、抑制视觉伪影方面表现良好,而学习得到的先验则有效增强锐利边缘并恢复细小结构。通过将这两个互补先验融入自适应范数重建框架,采用混合L1和L2正则化最小化求解,实现所需的遥感图像超分辨率重建。在多个遥感数据集上的大量实验表明,该方法能生成视觉效果优良的图像,在定量评估指标上优于多种先进算法。

原文摘要 · Abstract (English)

Image super-resolution (SR) is an effective way to enhance the spatial resolution and detail information of remote sensing images, to obtain a superior visual quality. As SR is severely ill-conditioned, effective image priors are necessary to regularize the solution space and generate the corresponding high-resolution (HR) image. In this paper, we propose a novel gradient-guided multi-frame super-resolution (MFSR) framework for remote sensing imagery reconstruction. The framework integrates a learned gradient prior as the regularization term into a model-based optimization method. Specifically, the local gradient regularization (LGR) prior is derived from the deep residual attention network (DRAN) through gradient profile transformation. The non-local total variation (NLTV) prior is characterized using the spatial structure similarity of the gradient patches with the maximum a posteriori (MAP) model. The modeled prior performs well in preserving edge smoothness and suppressing visual artifacts, while the learned prior is effective in enhancing sharp edges and recovering fine structures. By incorporating the two complementary priors into an adaptive norm based reconstruction framework, the mixed L1 and L2 regularization minimization problem is optimized to achieve the required HR remote sensing image. Extensive experimental results on remote sensing data demonstrate that the proposed method can produce visually pleasant images and is superior to several of the state-of-the-art SR algorithms in terms of the quantitative evaluation.

超分辨率遥感图像深度学习变分模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。