通过优化测量信息融合,用极少迭代次数实现扩散模型逆问题求解的提速与提质。
Enhancing and Accelerating Diffusion-Based Inverse Problem Solving through Measurements Optimization
- 在每步迭代中动态优化测量信息注入策略,提升信息利用效率。
- 仅需100次函数评估(NFE)即达当前最优性能,部分任务甚至低于100次。
- 可无缝嵌入现有扩散模型框架,适合追求高效高质图像重建的研究者。
扩散模型在求解逆问题方面取得显著进展,但现有方法通常需要大量函数评估(NFE)才能生成高质量图像,因每步仅融入有限测量信息。为加速该过程,本文提出测量优化(MO),一种高效且即插即用的模块,可在每步迭代中更优地整合测量信息。我们在FFHQ和ImageNet数据集上的8个线性与非线性任务中全面评估该方法。结果表明:(1)多数任务中仅需不超过100 NFE,ImageNet相位恢复为例外;(2)即使在低NFE下也达到SOTA或近SOTA效果;(3)可无缝集成至DPS与Red-diff等现有方法。例如,DPS-MO在FFHQ 256数据集上实现28.71 dB峰值信噪比(PSNR),仅用100 NFE,而现有方法需1000–4000 NFE方可达到相近性能。
原文摘要 · Abstract (English)
Diffusion models have recently demonstrated notable success in solving inverse problems. However, current diffusion model-based solutions typically require a large number of function evaluations (NFEs) to generate high-quality images conditioned on measurements, as they incorporate only limited information at each step. To accelerate the diffusion-based inverse problem-solving process, we introduce \textbf{M}easurements \textbf{O}ptimization (MO), a more efficient plug-and-play module for integrating measurement information at each step of the inverse problem-solving process. This method is comprehensively evaluated across eight diverse linear and nonlinear tasks on the FFHQ and ImageNet datasets. By using MO, we establish state-of-the-art (SOTA) performance across multiple tasks, with key advantages: (1) it operates with no more than 100 NFEs, with phase retrieval on ImageNet being the sole exception; (2) it achieves SOTA or near-SOTA results even at low NFE counts; and (3) it can be seamlessly integrated into existing diffusion model-based solutions for inverse problems, such as DPS \cite{chung2022diffusion} and Red-diff \cite{mardani2023variational}. For example, DPS-MO attains a peak signal-to-noise ratio (PSNR) of 28.71 dB on the FFHQ 256 dataset for high dynamic range imaging, setting a new SOTA benchmark with only 100 NFEs, whereas current methods require between 1000 and 4000 NFEs for comparable performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。