通过渐进式训练提升模型对极端模糊图像的恢复能力。
X-DECODE: EXtreme Deblurring with Curriculum Optimization and Domain Equalization
- 采用课程学习策略,逐步增加训练图像的模糊程度。
- 在Extreme-GoPro和Extreme-KITTI上分别提升14%和18%的SSIM。
- 适合自动驾驶与医学影像等需要高精度去模糊的场景。
严重模糊图像的恢复仍是计算机视觉中的重大挑战,影响自动驾驶、医学成像和摄影等应用。本文提出一种基于课程学习的新型训练策略,提升深度学习模型在极端图像去模糊任务中的鲁棒性。不同于传统仅在低至中等模糊水平上训练的方法,本方法随训练进程逐步引入更高模糊度的图像,使模型可渐进适应。同时,在训练中融合感知损失与铰链损失,以增强细节恢复并提升训练稳定性。我们在多种课程学习策略下进行实验,并研究了训练-测试域差异对去模糊性能的影响。在Extreme-GoPro数据集上,本方法优于次佳方法14% SSIM;在Extreme-KITTI数据集上,提升达18% SSIM。消融实验表明,线性课程进展优于分段、S型和指数进展;训练模糊比例及损失函数设计对缓解极端模糊伪影至关重要。代码与数据集已开源于https://github.com/RAPTOR-MSSTATE/XDECODE。
原文摘要 · Abstract (English)
Restoring severely blurred images remains a significant challenge in computer vision, impacting applications in autonomous driving, medical imaging, and photography. This paper introduces a novel training strategy based on curriculum learning to improve the robustness of deep learning models for extreme image deblurring. Unlike conventional approaches that train on only low to moderate blur levels, our method progressively increases the difficulty by introducing images with higher blur severity over time, allowing the model to adapt incrementally. Additionally, we integrate perceptual and hinge loss during training to enhance fine detail restoration and improve training stability. We experimented with various curriculum learning strategies and explored the impact of the train-test domain gap on the deblurring performance. Experimental results on the Extreme-GoPro dataset showed that our method outperforms the next best method by 14% in SSIM, whereas experiments on the Extreme-KITTI dataset showed that our method outperforms the next best by 18% in SSIM. Ablation studies showed that a linear curriculum progression outperforms step-wise, sigmoid, and exponential progressions, while hyperparameter settings such as the training blur percentage and loss function formulation all play important roles in addressing extreme blur artifacts. Datasets and code are available at https://github.com/RAPTOR-MSSTATE/XDECODE
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。