用多级蒙特卡洛降低扩散模型的贝叶斯计算成本
Bayesian computation with generative diffusion models by Multilevel Monte Carlo
- 通过多级蒙特卡洛策略,分级使用不同精度的扩散模型
- 在三个成像基准任务中实现4至8倍的计算成本降低
- 适合需要高效不确定性量化的大规模逆问题研究
生成式扩散模型近年来成为解决贝叶斯反问题中随机采样的有力工具,能为多种复杂应用提供高精度解。然而,扩散模型每次采样通常需大量神经网络函数评估,导致其作为蒙特卡洛积分采样器时计算成本高昂,尤其在需要大量样本进行不确定性量化的大规模反问题(如计算成像)中更为显著。本文针对定量成像应用,提出一种多级蒙特卡洛策略,利用扩散模型固有的成本-精度权衡,以可控方式耦合不同精度层级的模型,显著降低整体计算开销而不牺牲最终精度。该方法在三个基准成像问题上相较标准技术实现了4至8倍的计算成本缩减。
原文摘要 · Abstract (English)
Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a $4\times$-to-$8\times$ reduction in computational cost w.r.t. standard techniques across three benchmark imaging problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。