通过大规模模糊先验提升去模糊模型在真实场景下的泛化能力
Toward Generalizable Deblurring: Leveraging Massive Blur Priors with Linear Attention for Real-World Scenarios
- 利用仿真数据学习模糊先验,通过真实数据联合微调迁移
- 在六个基准和两个真实数据集上均实现领先性能,尤其在严重退化下表现优异
- 轻量级设计适合实际应用,适合追求实用性的工业开发者
图像去模糊虽因深度学习快速进步,但多数方法在训练数据外泛化能力差,真实场景中性能显著下降。分析表明,问题源于数据集在真实感与模糊模式多样性之间存在固有权衡,且算法设计受限:像素级损失促使模型关注局部细节而忽略结构语义一致性;扩散模型虽感知效果好,但在窄数据集上仍难泛化。我们发现模糊模式多样性是鲁棒泛化的关键,提出模糊模式预训练(BPP),从仿真数据获取模糊先验,并通过真实数据联合微调转移。进一步引入运动与语义引导(MoSeG)强化严重退化下的先验,集成至GLOWDeblur——一个结合卷积预重建与领域对齐模块、轻量级扩散骨干的通用轻量级真实世界去模糊模型。六项主流基准及两个真实数据集上的实验验证了方法有效性,确认模糊先验对鲁棒泛化的重要性,并证明GLOWDeblur的轻量设计适合实际部署。项目页见https://vegdog007.github.io/GLOWDeblur_Website/。
原文摘要 · Abstract (English)
Image deblurring has advanced rapidly with deep learning, yet most methods exhibit poor generalization beyond their training datasets, with performance dropping significantly in real-world scenarios. Our analysis shows this limitation stems from two factors: datasets face an inherent trade-off between realism and coverage of diverse blur patterns, and algorithmic designs remain restrictive, as pixel-wise losses drive models toward local detail recovery while overlooking structural and semantic consistency, whereas diffusion-based approaches, though perceptually strong, still fail to generalize when trained on narrow datasets with simplistic strategies. Through systematic investigation, we identify blur pattern diversity as the decisive factor for robust generalization and propose Blur Pattern Pretraining (BPP), which acquires blur priors from simulation datasets and transfers them through joint fine-tuning on real data. We further introduce Motion and Semantic Guidance (MoSeG) to strengthen blur priors under severe degradation, and integrate it into GLOWDeblur, a Generalizable reaL-wOrld lightWeight Deblur model that combines convolution-based pre-reconstruction & domain alignment module with a lightweight diffusion backbone. Extensive experiments on six widely-used benchmarks and two real-world datasets validate our approach, confirming the importance of blur priors for robust generalization and demonstrating that the lightweight design of GLOWDeblur ensures practicality in real-world applications. The project page is available at https://vegdog007.github.io/GLOWDeblur_Website/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。