用哈密顿-雅可比方程与生成模型结合,解决随机过程的贝叶斯反问题。
HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models
- 基于哈密顿-雅可比偏微分方程与得分生成模型构建新采样算法
- 在多种先验分布和模型误设下均有效,支持不确定性量化
- 适用于随机微分方程反问题,适合需要灵活采样的研究者
随机过程与最优控制之间的关系已被广泛研究。随着扩散模型的兴起,随机过程在采样生成中的应用日益增多。本文基于对数变换(布朗运动中称为科尔-霍普夫变换),在更抽象的框架中扩展该方法,引入线性算子。我们发现科尔-霍普夫变换与最优传输之间的经典联系,是当线性算子作为随机过程的无穷小生成元时的特例。此外,我们提出一种新情形:线性算子为生成元的伴随算子,关联于特定初末条件下的贝叶斯推断。基于此理论基础,我们提出名为HJ-sampler的新算法,用于求解具有终端观测值的随机微分方程的贝叶斯反问题。该算法包含两个阶段:(1) 求解粘性哈密顿-雅可比偏微分方程;(2) 从相关随机最优控制问题中采样。所提算法天然支持选择不同的粘性HJ PDE数值求解器。我们提出两种变体:基于里卡蒂方法的Riccati-HJ-sampler,以及利用扩散模型的SGM-HJ-sampler。通过应用于多种随机过程和先验分布的贝叶斯反问题,验证了方法的有效性与灵活性,包括处理模型误设和量化模型不确定性。
原文摘要 · Abstract (English)
The interplay between stochastic processes and optimal control has been extensively explored in the literature. With the recent surge in the use of diffusion models, stochastic processes have increasingly been applied to sample generation. This paper builds on the log transform, known as the Cole-Hopf transform in Brownian motion contexts, and extends it within a more abstract framework that includes a linear operator. Within this framework, we found that the well-known relationship between the Cole-Hopf transform and optimal transport is a particular instance where the linear operator acts as the infinitesimal generator of a stochastic process. We also introduce a novel scenario where the linear operator is the adjoint of the generator, linking to Bayesian inference under specific initial and terminal conditions. Leveraging this theoretical foundation, we develop a new algorithm, named the HJ-sampler, for Bayesian inference for the inverse problem of a stochastic differential equation with given terminal observations. The HJ-sampler involves two stages: (1) solving the viscous Hamilton-Jacobi partial differential equations, and (2) sampling from the associated stochastic optimal control problem. Our proposed algorithm naturally allows for flexibility in selecting the numerical solver for viscous HJ PDEs. We introduce two variants of the solver: the Riccati-HJ-sampler, based on the Riccati method, and the SGM-HJ-sampler, which utilizes diffusion models. We demonstrate the effectiveness and flexibility of the proposed methods by applying them to solve Bayesian inverse problems involving various stochastic processes and prior distributions, including applications that address model misspecifications and quantifying model uncertainty.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。