用重模糊引导训练,让模糊图像去模糊更准。
Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs
- 通过重模糊模块保持图像空间一致性,解决训练对齐问题。
- 从模糊图像重建可变模糊核,生成伪标签提升性能。
- 适合真实场景下无完美对齐数据的去模糊任务。
单图散焦去模糊任务中,获取完全对齐的训练样本(模糊图、全焦点清晰图及模糊图映射)极为困难。现有方法依赖专业设备采集对齐数据,但在真实场景中难以实现,训练对通常存在空间错位。本文提出一种重模糊引导的学习框架,可在错位训练对下训练去模糊网络。通过重建空间变化的各向同性模糊核,重模糊模块确保去模糊图、重模糊图与输入模糊图之间的空间一致性,有效提取清晰纹理。同时,由重模糊模块推导出的空间变化模糊核可作为训练时的伪监督信号,将训练对转化为训练三元组。为此,我们设计轻量级散焦模糊估计器与融合模块,与先进去模糊网络无缝集成,显著提升性能。此外,我们构建了含典型错位的新数据集SDD,既验证了方法有效性,也成为未来研究的基准。
原文摘要 · Abstract (English)
For single image defocus deblurring, acquiring well-aligned training pairs (or training triplets), i.e., a defocus blurry image, an all-in-focus sharp image (and a defocus blur map), is a challenging task for developing effective deblurring models. Existing image defocus deblurring methods typically rely on training data collected by specialized imaging equipment, with the assumption that these pairs or triplets are perfectly aligned. However, in practical scenarios involving the collection of real-world data, direct acquisition of training triplets is infeasible, and training pairs inevitably encounter spatial misalignment issues. In this work, we introduce a reblurring-guided learning framework for single image defocus deblurring, enabling the learning of a deblurring network even with misaligned training pairs. By reconstructing spatially variant isotropic blur kernels, our reblurring module ensures spatial consistency between the deblurred image, the reblurred image and the input blurry image, thereby addressing the misalignment issue while effectively extracting sharp textures from the all-in-focus sharp image. Moreover, spatially variant blur can be derived from the reblurring module, and serve as pseudo supervision for defocus blur map during training, interestingly transforming training pairs into training triplets. To leverage this pseudo supervision, we propose a lightweight defocus blur estimator coupled with a fusion block, which enhances deblurring performance through seamless integration with state-of-the-art deblurring networks. Additionally, we have collected a new dataset for single image defocus deblurring (SDD) with typical misalignments, which not only validates our proposed method but also serves as a benchmark for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。