arXiv:2409.07968stat.MLcs.LG2024-09被引 3

通过局部化降低高维采样计算成本,提升效率与稳定性。

Localized Schrödinger Bridge Sampler

  • 将高维问题分解为多个低维子问题,利用条件独立性降低复杂度。
  • 在高维高斯、时间序列等任务中表现稳定,收敛速度快。
  • 适合需要高效采样的高维概率建模与贝叶斯推断场景。

我们研究从仅能获取大量训练样本的未知分布中进行采样的问题。现有结合薛定谔桥与即插即用朗之万采样器的方法存在训练样本数量随维度 $d$ 指数增长的瓶颈。本文提出一种局部化策略,利用条件期望值的条件独立性,将单一高维薛定谔桥问题转化为 $d$ 个低维子问题。该方法与多头自注意力变换器架构存在关联。所提局部采样器保持原方法的稳定性和几何遍历性,并自然扩展至条件采样与贝叶斯推断。实验验证了其在高维高斯分布、时间随机过程以及随机亚网格参数化条件采样问题上的有效性。此外,还基于核去噪与Tweedie公式将局部化思想推广至即插即用朗之万采样器。

原文摘要 · Abstract (English)

We consider the problem of sampling from an unknown distribution for which only a sufficiently large number of training samples are available. In this paper, we build on previous work combining Schrödinger bridges and plug & play Langevin samplers. A key bottleneck of these approaches is the exponential dependence of the required training samples on the dimension, $d$, of the ambient state space. We propose a localization strategy which exploits conditional independence of conditional expectation values. Localization thus replaces a single high-dimensional Schrödinger bridge problem by $d$ low-dimensional Schrödinger bridge problems over the available training samples. In this context, a connection to multi-head self attention transformer architectures is established. As for the original Schrödinger bridge sampling approach, the localized sampler is stable and geometric ergodic. The sampler also naturally extends to conditional sampling and to Bayesian inference. We demonstrate the performance of our proposed scheme through experiments on a high-dimensional Gaussian problem, on a temporal stochastic process, and on a stochastic subgrid-scale parametrization conditional sampling problem. We also extend the idea of localization to plug & play Langevin samplers using kernel-based denoising in combination with Tweedie's formula.

采样算法薛定谔桥高维建模贝叶斯推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。