arXiv:2606.15458stat.MLcs.LG2026-06

用样条建模潜在变量依赖,提升贝叶斯推断精度

Structured Nonparametric Variational Inference for Dependent Latent Modeling

论文配图:Structured Nonparametric Variational Inference for Dependent Latent Modeling
图 1 · 摘自论文原文
  • 引入多变量样条构造后验近似,捕捉潜在变量复杂依赖
  • 理论证明下界存在且后验估计渐近一致,支持高维数据应用
  • 自动识别依赖结构,适用于图像与空间转录组等复杂数据

变分推断(VI)是现代人工智能的核心技术,支持大规模概率与生成模型的近似贝叶斯学习及不确定性感知训练。本文提出结构化非参数变分推断(SN-VI),一种基于多变量样条技术的新框架,用于在后验近似中建模潜在变量间的复杂依赖关系。与依赖均值场假设的传统方法不同,SN-VI保留了潜在变量间的精细依赖结构,可灵活、准确地逼近任意形状的后验分布。我们建立了严格的理论保证,包括变分目标下界的推导和后验估计的渐近一致性证明。为便于实际应用,我们开发了一种算法,能自动识别相关潜在变量及其依赖结构,无需人工指定。模拟实验验证了SN-VI在逼近有界支撑与复杂依赖的后验分布方面的有效性。该方法已成功应用于高维结构化数据,包括计算机视觉数据集和空间转录组数据,在生成模型性能上表现更优,并通过学习到的依赖结构有效揭示了耦合的生物信号。

原文摘要 · Abstract (English)

Variational inference (VI) is a core engine of modern AI, enabling scalable approximate Bayesian learning and uncertainty-aware training of large probabilistic and generative models. In this paper, we propose Structured Nonparametric Variational Inference (SN-VI), a novel framework for modeling complex dependencies among latent variables in posterior approximation, leveraging multivariate spline techniques. Unlike traditional methods that rely on the mean-field assumption, SN-VI preserves intricate latent variable dependencies, providing a flexible and accurate approximation of posteriors with arbitrary shapes. We establish rigorous theoretical guarantees, including the derivation of the lower bound for the variational objective and proof of asymptotic consistency in posterior estimation. To facilitate practical implementation, we develop an algorithm that automatically identifies dependent latent variables and their underlying dependence structure, without requiring manual specification. Simulation studies validate the effectiveness of SN-VI in approximating posterior distributions with bounded support and complex dependencies. The proposed method has been successfully applied to high-dimensional structured data, including computer vision datasets and spatial transcriptomics. In these applications, SN-VI demonstrates improved generative model performance and effectively uncovers coupled biological signals through the learned dependency structure.

变分推断潜在变量样条建模高维数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。