用数据自适应的高斯混合先验替代标准VAE的固定先验,提升生成质量与可控性。
eXact-Prior Variational Autoencoder (X-VAE): Learning Data-Adaptive Gaussian Mixture Priors for Latent Distributions

- 以预训练AE的隐变量均值和方差构建数据自适应先验
- 在保持重建质量的同时,使隐空间分布更贴近真实数据分布
- 通过缩放因子控制生成多样性与保真度,适合工程设计等严苛场景
变分自编码器(VAEs)通常假设隐空间服从标准各向同性高斯先验,这一假设常无法捕捉复杂数据的真实隐变量分布,限制重建精度、生成样本质量及隐空间表达能力。本文提出eXact-Prior VAE(X-VAE),用预训练自编码器(AE)隐变量的统计特性构建数据自适应先验:以AE隐码的实证均值与标准差参数化高斯先验,更贴合训练数据底层结构。生成时引入隐变量缩放因子,显式调控采样隐向量的方差,实现多样性与保真度的灵活平衡。该方法特别适用于工业与工程设计等需满足严格结构或功能约束的场景。我们给出了适配的数学公式与对应的KL散度目标函数,并在标准基准数据集上验证了方法。实验表明,X-VAE在保持重建质量的同时,使隐变量分布更贴近真实数据分布,提升了生成样本的真实性与可控性。
原文摘要 · Abstract (English)
Variational Autoencoders (VAEs) commonly assume a standard isotropic Gaussian prior over the latent space, an assumption that often fails to capture the true distribution of latent representations for complex datasets. This mismatch can limit reconstruction accuracy, reduce sample quality, and constrain the expressive power of the learned latent space. We propose the eXact-Prior Variational Autoencoder (X-VAE), a framework that replaces the conventional standard normal prior with a Gaussian prior derived from the latent representations of a pretrained autoencoder (AE). Specifically, the empirical mean and standard deviation of the AE latent codes are used to parameterize a data-adaptive prior that more closely reflects the underlying structure of the training data. During generation, X-VAE introduces a latent scaling factor that enables explicit control over the variance of the sampled latent vectors, providing a simple mechanism for balancing sample diversity and fidelity. This flexibility makes the proposed approach particularly well suited for applications such as industrial and engineering design, where generated solutions must satisfy strict structural or functional constraints while still permitting meaningful design exploration. We present the mathematical formulation of well-suited X-VAE, derive the corresponding KL divergence objective for the proposed prior, and evaluate the method on standard benchmark datasets. Experimental results demonstrate that X-VAE preserves reconstruction quality while producing latent representations that better align with the empirical data distribution, leading to improved controllability and more realistic generated samples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。