arXiv:2601.20756cs.LGstat.ML2026-01被引 2

提出新方法让扩散模型在函数空间中精准采样后验分布。

Supervised Guidance Training for Infinite-Dimensional Diffusion Models

  • 用无限维Doob h-变换实现扩散模型在函数空间的后验条件化
  • 推导出条件得分可分解为无条件得分与可学习引导项
  • 设计无需模拟的监督引导训练,提升采样效率与稳定性

基于得分的扩散模型已拓展至无限维函数空间,应用于偏微分方程相关的反问题。在贝叶斯反问题框架下,目标是从给定噪声观测条件下对先验进行条件化以采样函数后验分布。尽管扩散模型可在函数空间提供丰富先验,但其条件化采样理论尚未明确。本文在先验位于Cameron-Martin空间或相对于高斯测度绝对连续的假设下,证明可通过无限维版的Doob h-变换实现条件化,并发现条件得分可分解为无条件得分与一个引导项。由于引导项不可解析计算,我们提出一种无需模拟的监督引导训练目标(Supervised Guidance Training),实现高效稳定的后验采样。通过函数空间中的贝叶斯反问题数值实验验证了理论。本工作首次提供了在函数空间中微调已训练扩散模型以准确采样后验的完整方法。

原文摘要 · Abstract (English)

Score-based diffusion models have recently been extended to infinite-dimensional function spaces, with uses such as inverse problems arising from partial differential equations. In the Bayesian formulation of inverse problems, the aim is to sample from a posterior distribution over functions obtained by conditioning a prior on noisy observations. While diffusion models provide expressive priors in function space, the theory of conditioning them to sample from the posterior remains open. We address this, assuming that either the prior lies in the Cameron-Martin space, or is absolutely continuous with respect to a Gaussian measure. We prove that the models can be conditioned using an infinite-dimensional extension of Doob's $h$-transform, and that the conditional score decomposes into an unconditional score and a guidance term. As the guidance term is intractable, we propose a simulation-free score matching objective (called Supervised Guidance Training) enabling efficient and stable posterior sampling. We illustrate the theory with numerical examples on Bayesian inverse problems in function spaces. In summary, our work offers the first function-space method for fine-tuning trained diffusion models to accurately sample from a posterior.

扩散模型反问题函数空间后验采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。