提出可学习噪声预测的扩散超分模型,4步即可实现顶尖效果
LPNSR: Optimal Noise-Guided Diffusion Image Super-Resolution Via Learnable Noise Prediction
- 基于最大似然推导出最优中间噪声的解析解,指导噪声注入
- 仅用4步采样即达到领先性能,且无需依赖文本图像先验
- 适合追求高效高质图像超分的开发者和研究者
基于扩散的图像超分辨率旨在从低分辨率(LR)观测中重建高分辨率(HR)图像。然而,反向扩散过程中引入的固有随机性导致模型性能在不同采样运行间波动显著,尤其当采样轨迹压缩至有限步数时。一个关键但未被充分探索的问题是:每个中间扩散步骤应注入何种最优噪声?本文建立理论框架,从最大似然估计角度推导出扩散模型中最优中间噪声的闭式解析解,揭示了跨扩散范式的恒定条件依赖结构。我们在残差偏移扩散范式下实例化该框架,并设计一种受低分辨率引导的多输入感知噪声预测器,以替代随机高斯噪声。同时通过高质量预上采样网络缓解初始化偏差。紧凑的4步轨迹使整个反向链路可端到端优化,这对传统长轨迹扩散模型而言计算成本过高。大量实验表明,LPNSR在合成与真实世界数据集上均取得当前最佳感知性能,且不依赖任何大规模文本到图像先验。代码见 https://github.com/Faze-Hsw/LPNSR。
原文摘要 · Abstract (English)
Diffusion-based image super-resolution (SR) aims to reconstruct high-resolution (HR) images from low-resolution (LR) observations. However, the inherent randomness injected during the reverse diffusion process causes the performance of diffusion-based SR models to vary significantly across different sampling runs, particularly when the sampling trajectory is compressed into a limited number of steps. A critical yet underexplored question is: what is the optimal noise to inject at each intermediate diffusion step? In this paper, we establish a theoretical framework that derives the closed-form analytical solution for optimal intermediate noise in diffusion models from a maximum likelihood estimation perspective, revealing a consistent conditional dependence structure that generalizes across diffusion paradigms. We instantiate this framework under the residual-shifting diffusion paradigm and accordingly design an LR-guided multi-input-aware noise predictor to replace random Gaussian noise. We further mitigate initialization bias with a high-quality pre-upsampling network. The compact 4-step trajectory uniquely enables end-to-end optimization of the entire reverse chain, which is computationally prohibitive for conventional long-trajectory diffusion models. Extensive experiments demonstrate that LPNSR achieves state-of-the-art perceptual performance on both synthetic and real-world datasets, without relying on any large-scale text-to-image priors. The source code of our method can be found at https://github.com/Faze-Hsw/LPNSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。