用退化信息指导扩散模型,一步实现高效高质图像超分辨率
Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors
- 基于退化信息设计低秩适配模块,动态修正扩散模型参数
- 仅需一步生成即可达到领先性能,推理速度显著提升
- 适合追求快速超分且对画质要求高的实际应用
基于扩散的图像超分辨率方法通过利用大规模预训练文生图扩散模型作为先验,取得了显著进展。然而,这些方法仍面临两大挑战:需要数十次采样才能获得满意结果,限制了实际场景中的效率;以及忽视退化模型,而退化信息对解决超分辨率问题至关重要。本文提出一种新型一步式超分辨率模型,显著提升了效率。不同于现有微调策略,我们设计了针对超分辨率任务的退化引导低秩适配(LoRA)模块,根据低分辨率图像预估计的退化信息动态调整模型参数。该模块不仅构建了依赖数据或退化的强表达能力,还最大程度保留了预训练扩散模型的生成先验。此外,我们引入在线负样本生成策略,优化训练流程,并在推理阶段结合无分类器引导,大幅提升了重建结果的感知质量。大量实验表明,所提方法在效率和效果上均优于近期最先进方法。
原文摘要 · Abstract (English)
Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors. However, these methods still face two challenges: the requirement for dozens of sampling steps to achieve satisfactory results, which limits efficiency in real scenarios, and the neglect of degradation models, which are critical auxiliary information in solving the SR problem. In this work, we introduced a novel one-step SR model, which significantly addresses the efficiency issue of diffusion-based SR methods. Unlike existing fine-tuning strategies, we designed a degradation-guided Low-Rank Adaptation (LoRA) module specifically for SR, which corrects the model parameters based on the pre-estimated degradation information from low-resolution images. This module not only facilitates a powerful data-dependent or degradation-dependent SR model but also preserves the generative prior of the pre-trained diffusion model as much as possible. Furthermore, we tailor a novel training pipeline by introducing an online negative sample generation strategy. Combined with the classifier-free guidance strategy during inference, it largely improves the perceptual quality of the super-resolution results. Extensive experiments have demonstrated the superior efficiency and effectiveness of the proposed model compared to recent state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。