提出三个可解析求解的贝叶斯反问题基准,用于评估扩散模型采样器性能。
Benchmarking Diffusion Annealing-Based Bayesian Inverse Problem Solvers
- 构建基于扩散退火的统一框架,整合多种扩散模型反问题求解算法。
- 在图像修复、X射线断层成像等真实场景中验证算法,获得可解析的后验样本。
- 为未来算法开发提供可复现的测试基准,尤其适合关注不确定性量化研究者。
近年来,扩散模型作为先进的生成建模方法,引发了将其用作贝叶斯反问题先验的广泛关注。然而,如何将训练好的先验扩散模型与给定似然函数结合以获得后验样本仍不明确。尽管现有算法能生成高质量且多样化的未知参数估计,但通常在先验分布无法解析的情况下测试,难以评估其不确定性量化能力。为此,本文提出了三个受图像修补、X射线断层成像和相位恢复启发的基准问题,其后验密度可解析求得。在此设定下,可获得近似真实后验样本,实现对后验采样算法的严格评估。本文还提出一种通用框架——通过扩散退火的贝叶斯反问题求解器(BIPSDA),统一了近期提出的多种基于扩散模型的后验采样算法,并支持灵活组合设计。我们测试了包括前沿方法在内的多组BIPSDA算法在这些基准上的表现,揭示了现有方法的优劣,同时为未来算法发展提供了可复现的测试平台。
原文摘要 · Abstract (English)
In recent years, the ascendance of diffusion modeling as a state-of-the-art generative modeling approach has spurred significant interest in their use as priors in Bayesian inverse problems. However, it is unclear how to optimally integrate a diffusion model trained on the prior distribution with a given likelihood function to obtain posterior samples. While algorithms developed for this purpose can produce high-quality, diverse point estimates of the unknown parameters of interest, they are often tested on problems where the prior distribution is analytically unknown, making it difficult to assess their performance in providing rigorous uncertainty quantification. Motivated by this challenge, this work introduces three benchmark problems for evaluating the performance of diffusion model based samplers. The benchmark problems, which are inspired by problems in image inpainting, x-ray tomography, and phase retrieval, have a posterior density that is analytically known. In this setting, approximate ground-truth posterior samples can be obtained, enabling principled evaluation of the performance of posterior sampling algorithms. This work also introduces a general framework for diffusion model based posterior sampling, Bayesian Inverse Problem Solvers through Diffusion Annealing (BIPSDA). This framework unifies several recently proposed diffusion-model-based posterior sampling algorithms and contains novel algorithms that can be realized through flexible combinations of design choices. We tested the performance of a set of BIPSDA algorithms, including previously proposed state-of-the-art approaches, on the proposed benchmark problems. The results provide insight into the strengths and limitations of existing diffusion-model based posterior samplers, while the benchmark problems provide a testing ground for future algorithmic developments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。