用傅里叶分析加速贝叶斯更新,实现O(N log N)高效推断。
Fast Bayesian Updates via Harmonic Representations
- 将先验与似然表示在正交基上,使贝叶斯更新变为谱卷积。
- 通过频谱截断与FFT,将计算复杂度降至O(N log N)。
- 适用于平滑分布,适合实时序列推断场景。
贝叶斯推断虽是概率推理的基础,但常因后验分布的计算不可行而受限,尤其是证据积分难以求解。传统方法如马尔可夫链蒙特卡洛(MCMC)和变分推断(VI)存在可扩展性与效率瓶颈。本文提出一种基于调和分析的统一框架,实现快速贝叶斯更新。我们证明,在合适正交基下表示先验与似然,可将贝叶斯更新规则转化为谱卷积:后验的傅里叶系数为先验与似然系数的归一化卷积。为保证计算可行性,引入频谱截断方案,对光滑函数可得极佳有限维近似,并将更新简化为循环卷积。该形式可利用快速傅里叶变换(FFT),实现确定性算法,复杂度为O(N log N),远优于朴素方法的O(N²)。文中建立了方法适用性的严格数学条件,其效率与分布的平滑性及谱衰减特性相关。本工作实现了贝叶斯计算与信号处理的范式融合,为广泛问题中的实时、顺序推断开辟新路径。
原文摘要 · Abstract (English)
Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov Chain Monte Carlo (MCMC) and Variational Inference (VI) face significant scalability and efficiency limitations. This paper introduces a novel, unifying framework for fast Bayesian updates by leveraging harmonic analysis. We demonstrate that representing the prior and likelihood in a suitable orthogonal basis transforms the Bayesian update rule into a spectral convolution. Specifically, the Fourier coefficients of the posterior are shown to be the normalized convolution of the prior and likelihood coefficients. To achieve computational feasibility, we introduce a spectral truncation scheme, which, for smooth functions, yields an exceptionally accurate finite-dimensional approximation and reduces the update to a circular convolution. This formulation allows us to exploit the Fast Fourier Transform (FFT), resulting in a deterministic algorithm with O(N log N) complexity -- a substantial improvement over the O(N^2) cost of naive methods. We establish rigorous mathematical criteria for the applicability of our method, linking its efficiency to the smoothness and spectral decay of the involved distributions. The presented work offers a paradigm shift, connecting Bayesian computation to signal processing and opening avenues for real-time, sequential inference in a wide class of problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。