用扩散模型直接采样后验分布,无需近似假设。
Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach
- 基于预训练得分函数构建无近似的粒子演化方程。
- 在图像重建任务中,相比现有方法提升重构精度。
- 适合需要高精度后验采样的逆问题研究者。
扩散模型(DMs)在建模高维分布方面表现优异,被广泛用于贝叶斯逆问题(BIPs)中的复杂先验表示。然而,当前基于扩散模型的后验采样方法依赖于生成过程的启发式近似。为充分挖掘扩散模型的生成能力并避免此类近似,本文提出一种基于集成的算法,在不使用启发式近似的情况下实现后验采样。该算法受已有结合扩散模型与序贯蒙特卡洛(SMC)方法的研究启发,通过分析预训练得分函数编码的扩散过程中先验的演化,推导出对应后验分布演化的修正偏微分方程(PDE)。该方程包含修正的扩散项和重加权项,可通过随机加权粒子法模拟。理论上,我们证明了真实后验分布的误差可由预训练得分函数的训练误差与粒子数量控制。实验上,我们在多个成像逆问题中验证了该方法,结果表明其重构精度优于现有基于扩散模型的方法。
原文摘要 · Abstract (English)
Diffusion models (DMs) have proven to be effective in modeling high-dimensional distributions, leading to their widespread adoption for representing complex priors in Bayesian inverse problems (BIPs). However, current DM-based posterior sampling methods proposed for solving common BIPs rely on heuristic approximations to the generative process. To exploit the generative capability of DMs and avoid the usage of such approximations, we propose an ensemble-based algorithm that performs posterior sampling without the use of heuristic approximations. Our algorithm is motivated by existing works that combine DM-based methods with the sequential Monte Carlo (SMC) method. By examining how the prior evolves through the diffusion process encoded by the pre-trained score function, we derive a modified partial differential equation (PDE) governing the evolution of the corresponding posterior distribution. This PDE includes a modified diffusion term and a reweighting term, which can be simulated via stochastic weighted particle methods. Theoretically, we prove that the error between the true posterior distribution can be bounded in terms of the training error of the pre-trained score function and the number of particles in the ensemble. Empirically, we validate our algorithm on several inverse problems in imaging to show that our method gives more accurate reconstructions compared to existing DM-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。