用分段引导提升扩散模型求解逆问题的效率与精度
Diffusion Models for Solving Inverse Problems via Posterior Sampling with Piecewise Guidance
- 设计分段引导机制,分阶段使用不同近似方式优化采样过程
- 在图像修复和超分辨率任务中,推理速度提升23%~25%,损失极小
- 无需重训练即可适配多种逆问题,适合实际应用部署
扩散模型通过逐步去噪过程从高维分布中采样,结合引导机制可生成条件样本。本文提出一种基于扩散的通用框架,用于求解逆问题,采用分段式引导策略,将引导项定义为扩散步数的分段函数,分别在高噪声和低噪声阶段使用不同近似方式,有效平衡计算效率与引导精度。该方法不依赖特定任务,无需针对每类问题重新训练,可直接应用于多种逆问题,并显式建模测量噪声。在图像修复任务(包括随机掩码与中心掩码的图像修复、4×和8×超分辨率)上实验验证,相较于伪逆引导扩散模型(ΠGDM),推理时间分别减少25%(修复)、23%(4×超分)、24%(8×超分),同时PSNR和SSIM损失可忽略不计。
原文摘要 · Abstract (English)
Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also generate samples from conditional distributions. In this paper, a novel diffusion-based framework is introduced for solving inverse problems using a piecewise guidance scheme. The guidance term is defined as a piecewise function of the diffusion timestep, facilitating the use of different approximations during high-noise and low-noise phases. This design is shown to effectively balance computational efficiency with the accuracy of the guidance term. Unlike task-specific approaches that require retraining for each problem, the proposed method is problem-agnostic and readily adaptable to a variety of inverse problems. Additionally, it explicitly incorporates measurement noise into the reconstruction process. The effectiveness of the proposed framework is demonstrated through extensive experiments on image restoration tasks, specifically image inpainting and super-resolution. Using a class conditional diffusion model for recovery, compared to the \blue{pseudoinverse-guided diffusion model (\textrm{\(Π\)}GDM) baseline}, the proposed framework achieves a reduction in inference time of \(25\%\) for inpainting with both random and center masks, and \(23\%\) and \(24\%\) for \(4\times\) and \(8\times\) super-resolution tasks, respectively, while incurring only negligible loss in PSNR and SSIM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。