用一步扩散模型实现真实世界超分,速度更快且无高频伪影。
One Diffusion Step to Real-World Super-Resolution via Flow Trajectory Distillation
- 通过流轨迹蒸馏将多步模型压缩为一步,提升推理效率。
- 在Real-ISR任务中超越现有一步扩散方法,图像更真实清晰。
- 适合追求高速超分且注重图像质量的视觉应用开发者。
扩散模型显著推动了真实世界图像超分辨率(Real-ISR)的发展,但多步扩散模型计算开销大,限制了实际应用。一步扩散模型仅需一次采样即可生成高质量图像,大幅降低计算成本和推理延迟。然而,现有一步扩散方法性能受限于教师模型,若教师模型表现差,则会产生图像伪影。为此,我们提出FluxSR,一种基于流匹配模型的一步扩散真实世界超分辨率方法。采用最先进的扩散模型FLUX.1-dev作为教师模型和基础模型。首先,引入流轨迹蒸馏(FTD),将多步流匹配模型蒸馏为一步超分辨率模型;其次,为提升图像真实感并解决生成图像中的高频伪影问题,提出TV-LPIPS感知损失,并引入注意力多样性损失(ADL)作为正则项,降低Transformer中令牌相似性,从而消除高频伪影。全面实验表明,该方法优于现有一步扩散基超分辨率方法。代码与模型将发布于https://github.com/JianzeLi-114/FluxSR。
原文摘要 · Abstract (English)
Diffusion models (DMs) have significantly advanced the development of real-world image super-resolution (Real-ISR), but the computational cost of multi-step diffusion models limits their application. One-step diffusion models generate high-quality images in a one sampling step, greatly reducing computational overhead and inference latency. However, most existing one-step diffusion methods are constrained by the performance of the teacher model, where poor teacher performance results in image artifacts. To address this limitation, we propose FluxSR, a novel one-step diffusion Real-ISR technique based on flow matching models. We use the state-of-the-art diffusion model FLUX.1-dev as both the teacher model and the base model. First, we introduce Flow Trajectory Distillation (FTD) to distill a multi-step flow matching model into a one-step Real-ISR. Second, to improve image realism and address high-frequency artifact issues in generated images, we propose TV-LPIPS as a perceptual loss and introduce Attention Diversification Loss (ADL) as a regularization term to reduce token similarity in transformer, thereby eliminating high-frequency artifacts. Comprehensive experiments demonstrate that our method outperforms existing one-step diffusion-based Real-ISR methods. The code and model will be released at https://github.com/JianzeLi-114/FluxSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。