用预训练模型加速图像修复,修复更准更快。
ScaleResfusion: Residual Rectified Flow based on Residual Vector Field

- 在预训练扩散模型基础上引入残差流,从低质噪声图开始修复。
- 修复速度提升5倍以上,且保持与原模型一致的输出质量。
- 适合需要高效适配大模型的图像修复研究者或工业应用。
真实世界图像修复(Real-IR)旨在从复杂未知退化中恢复高质量(HQ)图像。尽管基于扩散的方法显著提升了感知质量,但现有设计仍存在两大挑战:从高斯噪声开始的方法速度慢且对输入退化不忠实;基于残差的方法通常从头训练,难以利用现代预训练生成先验。本文提出ScaleResfusion,一种基于预训练文本到图像矩形流模型的可扩展扩散框架。核心是残差矩形流(Residual Rectified Flow),将残差项R引入标准矩形流,不再从纯噪声开始,而是从含噪低质(LQ)图像出发,具备精确加速点。通过学习残差向量场,该方法保持输出分布与线性扩散过程与预训练模型一致,实现参数高效的规模化微调。我们进一步设计知识蒸馏流水线,在降低采样成本的同时维持修复质量。在多个真实世界修复任务上的实验表明,ScaleResfusion达到当前最佳性能,效率显著更高。结果表明,该方法为大规模预训练扩散模型适配真实世界图像修复提供了实用且可扩展的路径。代码与模型已开源。
原文摘要 · Abstract (English)
Real-world Image Restoration (Real-IR) aims to recover high-quality (HQ) images from complex and unknown degradations. Although recent diffusion-based methods have substantially improved perceptual quality, their current designs leave two key challenges unresolved. Methods that start from Gaussian noise are slow and often less faithful to the degraded input. Residual-based methods usually train from scratch, which makes it hard to exploit modern pre-trained generative priors. In this paper, we present ScaleResfusion, a scalable diffusion framework for real-world image restoration built on pre-trained text-to-image rectified-flow models. The core of our method is Residual Rectified Flow, which introduces the residual term R into Standard Rectified Flow. Instead of starting from pure noise, it uses a residual transport path that starts from noisy low-quality (LQ) images and admits an exact acceleration point. By learning the residual vector field, Residual Rectified Flow keeps the output distribution and linear diffusion process consistent with the pre-trained rectified-flow models. This makes parameter-efficient fine-tuning possible at scale. We further introduce a knowledge-distillation pipeline to reduce sampling cost while maintaining restoration quality. Extensive experiments on multiple real-world restoration tasks show that ScaleResfusion achieves state-of-the-art performance with much higher efficiency. These results suggest a practical and scalable way to adapt large pre-trained diffusion models to real-world image restoration. Our code and models are available at https://github.com/YukinoshitaLove/ScaleResfusion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。