提出高斯不变的采样方法,提升复杂分布采样效率
Gaussian Invariant Markov Chain Monte Carlo
- 基于高斯不变性设计新型马尔可夫链采样器
- 在高维隐变量模型中实现最优采样效果
- 适合需要高效贝叶斯推断的研究者
我们开发了高斯不变版本的随机游走梅特罗波利斯(RWM)、调整朗之万算法(MALA)及二阶海森或流形MALA采样方法。与标准方法不同,高斯不变采样可产生具有改进统计效率的遍历估计量。这得益于高斯不变性带来的特性:对高斯目标可获得泊松方程的精确解析解,进而构建高效且易用的控制变量,用于任意不可解目标下的估计方差降低。我们在多个例子中验证新采样器和估计器,包括高维隐高斯模型,与多种先进方法对比,取得当前最优结果。同时提供几何遍历性理论结果及最优缩放分析,揭示最优接受率与目标高斯性的依赖关系。
原文摘要 · Abstract (English)
We develop sampling methods, which consist of Gaussian invariant versions of random walk Metropolis (RWM), Metropolis adjusted Langevin algorithm (MALA) and second order Hessian or Manifold MALA. Unlike standard RWM and MALA, we show that Gaussian invariant sampling can lead to ergodic estimators with improved statistical efficiency. This is due to a remarkable property of Gaussian invariance that allows us to obtain exact analytical solutions to the Poisson equation for Gaussian targets. These solutions can be used to construct efficient and easy to use control variates for variance reduction of estimators under any intractable target. We demonstrate the new samplers and estimators in several examples, including high dimensional targets in latent Gaussian models where we compare against several advanced methods and obtain state-of-the-art results. We also provide theoretical results regarding geometric ergodicity, and an optimal scaling analysis that shows the dependence of the optimal acceptance rate on the Gaussianity of the target.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。