arXiv:2508.08227cs.CVcs.AI2025-08被引 13

仅用一个中间时间步引导,实现真实图像超分辨率的突破

OMGSR: You Only Need One Mid-timestep Guidance for Real-World Image Super-Resolution

  • 基于信噪比预计算最优中间时间步注入
  • 引入精炼损失与LoRA微调,提升隐变量逼近效果
  • 适合追求高效高质图像超分的开发者与研究者

去噪扩散概率模型(DDPM)在一步真实世界图像超分辨率(Real-ISR)中展现出潜力。现有方法通常在调度器起始或结束时间步注入低质量图像隐表示。近期研究表明,低质量图像隐表示与预训练噪声隐表示在中间时间步更接近,但缺乏定量分析。我们基于信号-噪声比(SNR)提出预计算平均最优中间时间步的方法。为更好逼近预训练噪声隐表示,引入通过LoRA增强的VAE编码器的隐表示精炼(LRR)损失,并使用LoRA微调基于DDPM的生成模型,在平均最优中间时间步执行一步去噪。在此基础上,提出OMGSR框架,采用基于DDPM的生成器与DINOv3-ConvNeXt多级判别头的判别器。还设计了针对多尺度结构感知的DINOv3-ConvNeXt DISTS(Dv3CD)损失。基于SD2.1-base开发了OMGSR-S。消融实验验证了预计算策略与LRR损失的有效性。对比实验表明,OMGSR-S在多个指标上达到当前最优性能。代码已开源。

原文摘要 · Abstract (English)

Denoising Diffusion Probabilistic Models (DDPMs) show promising potential in one-step Real-World Image Super-Resolution (Real-ISR). Current one-step Real-ISR methods typically inject the low-quality (LQ) image latent representation at the start or end timestep of the DDPM scheduler. Recent studies have begun to note that the LQ image latent and the pre-trained noisy latent representations are intuitively closer at a mid-timestep. However, a quantitative analysis of these latent representations remains lacking. Considering these latent representations can be decomposed into signal and noise, we propose a method based on the Signal-to-Noise Ratio (SNR) to pre-compute an average optimal mid-timestep for injection. To better approximate the pre-trained noisy latent representation, we further introduce the Latent Representation Refinement (LRR) loss via a LoRA-enhanced VAE encoder. We also fine-tune the backbone of the DDPM-based generative model using LoRA to perform one-step denoising at the average optimal mid-timestep. Based on these components, we present OMGSR, a GAN-based Real-ISR framework that employs a DDPM-based generative model as the generator and a DINOv3-ConvNeXt model with multi-level discriminator heads as the discriminator. We also propose the DINOv3-ConvNeXt DISTS (Dv3CD) loss, which is enhanced for structural perception at varying resolutions. Within the OMGSR framework, we develop OMGSR-S based on SD2.1-base. An ablation study confirms that our pre-computation strategy and LRR loss significantly improve the baseline. Comparative studies demonstrate that OMGSR-S achieves state-of-the-art performance across multiple metrics. Code is available at \hyperlink{Github}{https://github.com/wuer5/OMGSR}.

图像超分扩散模型中间引导低质量修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。