arXiv:2412.20385math.STcs.LG2024-12被引 4

提出新型粒子算法,实现非参数化均场变分推断的理论保证。

A Particle Algorithm for Mean-Field Variational Inference

  • 用粒子方法替代传统参数假设,实现非参数均场近似。
  • 首次给出粒子型均场推断的非渐近误差界。
  • 适合需要理论保障的复杂后验推断任务。

变分推断是马尔可夫链蒙特卡洛的快速可扩展替代方法,广泛应用于统计与机器学习中的后验推断。传统均场变分推断(MFVI)常采用坐标上升变分推断(CAVI),依赖于完整条件分布的参数假设。本文提出一种基于粒子的新算法PArticle VI(PAVI),用于非参数均场近似,并给出了该算法的非渐近误差界。据我们所知,这是首个针对粒子型均场推断的端到端理论保证。

原文摘要 · Abstract (English)

Variational inference is a fast and scalable alternative to Markov chain Monte Carlo and has been widely applied to posterior inference tasks in statistics and machine learning. A traditional approach for implementing mean-field variational inference (MFVI) is coordinate ascent variational inference (CAVI), which relies crucially on parametric assumptions on complete conditionals. We introduce a novel particle-based algorithm for MFVI, named PArticle VI (PAVI), for nonparametric mean-field approximation. We obtain non-asymptotic error bounds for our algorithm. To our knowledge, this is the first end-to-end guarantee for particle-based MFVI.

变分推断粒子方法理论保证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。