arXiv:2409.00988cs.CV2024-09被引 1

通过多尺度交替优化,无需标签即可修复真实世界的大规模模糊图像。

Self-Supervised Multi-Scale Network for Blind Image Deblurring via Alternating Optimization

  • 构建多输入多输出的多尺度生成网络,利用模糊图像金字塔自监督估计清晰图像。
  • 在每尺度独立求解正则化最小二乘问题,灵活适配图像估计器并高效估计模糊核。
  • 避免传统方法的粗到精传播和额外去模糊步骤,适合处理大范围真实模糊场景。

盲图像去模糊是低层视觉中的一项挑战性任务,需在模糊核未知的情况下恢复清晰图像。本文提出一种自监督多尺度盲去模糊方法,通过交替优化联合估计潜在图像与模糊核。图像估计阶段采用多尺度生成网络,接收多输入多输出,借助仅由模糊图像构建的图像金字塔进行自监督,该网络架构约束了模型结构,无需显式定义图像先验。模糊核估计阶段,在各尺度上独立求解带二次正则化的最小二乘模型,实现对多尺度图像估计器的灵活适配。得益于多尺度间的协同估计,本方法避免了传统数学优化方法中计算密集的粗到精传播及额外去模糊流程。在合成与真实数据集上的定量与定性实验表明,该方法性能优越,尤其在处理大尺度和真实世界模糊时表现突出。

原文摘要 · Abstract (English)

Blind image deblurring is a challenging low-level vision task that involves estimating the unblurred image when the blur kernel is unknown. In this paper, we present a self-supervised multi-scale blind image deblurring method to jointly estimate the latent image and the blur kernel via alternating optimization. In the image estimation step, we construct a multi-scale generator network with multiple inputs and multiple outputs to collaboratively estimate latent images at various scales, supervised by an image pyramid constructed from only the blurred image. This generator places architectural constraints on the network and avoids the need for mathematical expression of image priors. In the blur kernel estimation step, the blur kernel at each scale is independently estimated with a direct solution to a quadratic regularized least-squares model for its flexible adaptation to the proposed multi-scale generator for image estimation. Thanks to the collaborative estimation across multiple scales, our method avoids the computationally intensive coarse-to-fine propagation and additional image deblurring processes used in traditional mathematical optimization-based methods. Quantitative and qualitative experimental results on synthetic and realistic datasets demonstrate the superior performance of our method, especially for handling large and real-world blurs.

图像去模糊自监督多尺度交替优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。