arXiv:2505.18276stat.MLcs.LG2025-05NeurIPS被引 5

用分数生成模型解决无限维贝叶斯反问题,理论证明收敛性并设计最优预条件器。

Preconditioned Langevin Dynamics with Score-Based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problems

  • 在函数空间中使用分数生成模型作先验,结合预条件朗之万动力学采样
  • 首次给出误差估计,明确依赖于分数估计误差,确保整体收敛
  • 适用于高斯与非高斯先验,适合需稳定解的科学计算场景

在无限维函数空间中直接求解高维贝叶斯反问题对保证离散化细化时的稳定性与收敛性至关重要。本文分析了一种广泛使用的线性反问题采样器:基于分数生成模型(SGMs)作为先验的朗之万动力学,其在函数空间中直接定义。基于希尔伯特空间中SGM的理论框架,我们首次在无限维设定下严格定义该采样器,并推导出首次显式依赖于分数近似误差的误差估计。由此获得在后验函数空间上关于相对熵(Kullback-Leibler divergence)全局收敛的充分条件。为防止数值不稳定,需对朗之万算法进行预条件处理,我们证明了最优预条件器的存在性及其形式,该预条件器同时依赖于分数误差与前向算子,可保证所有后验模态下的统一收敛速率。分析适用于高斯和一类广义非高斯先验。最后通过实例验证了理论结果。

原文摘要 · Abstract (English)

Designing algorithms for solving high-dimensional Bayesian inverse problems directly in infinite-dimensional function spaces - where such problems are naturally formulated - is crucial to ensure stability and convergence as the discretization of the underlying problem is refined. In this paper, we contribute to this line of work by analyzing a widely used sampler for linear inverse problems: Langevin dynamics driven by score-based generative models (SGMs) acting as priors, formulated directly in function space. Building on the theoretical framework for SGMs in Hilbert spaces, we give a rigorous definition of this sampler in the infinite-dimensional setting and derive, for the first time, error estimates that explicitly depend on the approximation error of the score. As a consequence, we obtain sufficient conditions for global convergence in Kullback-Leibler divergence on the underlying function space. Preventing numerical instabilities requires preconditioning of the Langevin algorithm and we prove the existence and the form of an optimal preconditioner. The preconditioner depends on both the score error and the forward operator and guarantees a uniform convergence rate across all posterior modes. Our analysis applies to both Gaussian and a general class of non-Gaussian priors. Finally, we present examples that illustrate and validate our theoretical findings.

贝叶斯反问题分数生成模型朗之万动力学函数空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。