提出一种可证明收敛的扩散后验采样方法,高效解决线性逆问题。
Provable diffusion-based posterior sampling for linear inverse problems via DDIM
- 按测量算子奇异方向分步采样,结合扩散先验与观测数据
- 在低信噪比时用扩散模型,在高信噪比时切换为观测预测
- 理论保证后验一致性,适合图像恢复等任务快速实现
基于扩散的方法在求解逆问题上取得了显著的实证成功。然而,许多现有的后验采样器要么缺乏严格的理论保证,要么带来较大的计算开销。我们提出一种简单高效的算法 \\(\text{PDDIM}\\),通过类 DDIM 的采样器解决带有扩散先验的线性逆问题。该方法仅需对标准 DDIM 更新进行轻量级、逐坐标修改,并显式融合观测模型。核心思想是沿测量算子的每个奇异方向分别进行后验采样:当观测信噪比低于对应扩散信噪比时,遵循学习到的扩散先验;否则切换为校准后的观测基预测器。我们证明了所提采样器收敛至给定观测的贝叶斯后验。实验结果表明,该采样器在多种图像修复任务中优于现有基于扩散的后验采样器,多数评估指标表现最佳。总体而言,我们的方法将噪声线性逆问题的后验采样简化为简单的逐坐标 DDIM 更新,得到一个高效、易实现且具有可证明后验一致性的算法。
原文摘要 · Abstract (English)
Diffusion-based methods have achieved remarkable empirical success in solving inverse problems. However, many existing posterior samplers either lack rigorous theoretical guarantees or incur substantial computational overhead. We propose a simple and efficient algorithm, called \pddim, for solving linear inverse problems with diffusion priors via a DDIM-type sampler. Our method requires only lightweight, coordinate-wise modifications to the standard DDIM update, while explicitly incorporating the measurement model. The key idea is to perform posterior sampling separately along each singular direction of the measurement operator: for each direction, the sampler follows the learned diffusion prior when the observation signal-to-noise ratio (SNR) is below the corresponding diffusion SNR, and switches to a calibrated measurement-based predictor otherwise. We prove that the proposed sampler converges to the Bayesian posterior conditioned on the measurements. Empirical results show that the proposed sampler performs favorably against existing diffusion-based posterior samplers across a range of image restoration tasks, achieving the best performance on the majority of evaluation metrics considered. Overall, our results convert posterior sampling for noisy linear inverse problems to simple coordinate-wise DDIM updates, yielding an efficient, easy-to-implement algorithm with provable posterior consistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。