让扩散模型快速修复图像,仅用几步就达到高精度。
MACS: Measurement-Aware Consistency Sampling for Inverse Problems
- 用测量一致性机制控制采样随机性,保证结果符合观测数据。
- 在多个数据集上,用极少步数就超越传统扩散与一致性模型。
- 适合需要快速高质量重建的医学影像、超分辨率等场景。
扩散模型已成为解决逆成像问题的强大生成先验,但其实际应用受限于多步采样带来的高计算成本。尽管一致性模型(CMs)通过单步或少步采样实现高质量生成,但其直接应用于逆问题仍鲜有探索。本文提出一种专为逆问题设计的一致性采样改进框架,通过利用退化算子的测量一致性机制调控采样随机性,在保持一致性生成效率的同时,确保输出与观测数据一致。在Fashion-MNIST和LSUN Bedroom数据集上的全面实验表明,该方法在感知与像素级指标(包括FID、KID、PSNR、SSIM)上均优于基线一致性模型与扩散模型采样方法。所提方法仅需少量采样步骤即可实现竞争力或更优的重建质量。
原文摘要 · Abstract (English)
Diffusion models have emerged as powerful generative priors for solving inverse imaging problems. However, their practical deployment is hindered by the substantial computational cost of slow, multi-step sampling. Although Consistency Models (CMs) address this limitation by enabling high-quality generation in only one or a few steps, their direct application to inverse problems has remained largely unexplored. This paper introduces a modified consistency sampling framework specifically designed for inverse problems. The proposed approach regulates the sampler's stochasticity through a measurement-consistency mechanism that leverages the degradation operator, thereby enforcing fidelity to the observed data while preserving the computational efficiency of consistency-based generation. Comprehensive experiments on the Fashion-MNIST and LSUN Bedroom datasets demonstrate consistent improvements across both perceptual and pixel-level metrics, including the Fréchet Inception Distance (FID), Kernel Inception Distance (KID), peak signal-to-noise ratio (PSNR), and structural similarity index measure (SSIM), compared with baseline consistency and diffusion-based sampling methods. The proposed method achieves competitive or superior reconstruction quality with only a small number of sampling steps.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。