用多β值学习可插值的解耦表征,兼顾生成质量与可解释性。
Denoising Multi-Beta VAE: Representation Learning for Disentanglement and Generation
- 训练单个VAE并用不同β值生成多组潜变量表示
- 通过非线性扩散模型实现潜空间平滑过渡,提升重建清晰度
- 支持无输入生成,适合需要可控生成的场景
生成模型中的解耦与可解释潜变量通常以牺牲生成质量为代价。β-VAE通过超参数β平衡解耦与重构质量,当β>1时引入信息瓶颈,更注重解耦而非高保真重建。为此,我们提出一种新框架:利用多个β值学习对应的不同潜变量表示。首先,通过改进损失函数训练单一变分自编码器(VAE),使较高β值的表示更强调解耦而非重建精度;随后引入非线性扩散模型,平滑地从高β(解耦强)向低β(信息丰富)表示过渡,逐步去噪,最终实现近乎无损的潜表示,支持清晰重建。此外,该模型无需输入即可生成样本,具备独立生成能力。我们在解耦性和生成质量上进行评估,并观察到潜空间随β变化呈现平滑过渡,支持输出的一致操控。
原文摘要 · Abstract (English)
Disentangled and interpretable latent representations in generative models typically come at the cost of generation quality. The $β$-VAE framework introduces a hyperparameter $β$ to balance disentanglement and reconstruction quality, where setting $β> 1$ introduces an information bottleneck that favors disentanglement over sharp, accurate reconstructions. To address this trade-off, we propose a novel generative modeling framework that leverages a range of $β$ values to learn multiple corresponding latent representations. First, we obtain a slew of representations by training a single variational autoencoder (VAE), with a new loss function that controls the information retained in each latent representation such that the higher $β$ value prioritize disentanglement over reconstruction fidelity. We then, introduce a non-linear diffusion model that smoothly transitions latent representations corresponding to different $β$ values. This model denoises towards less disentangled and more informative representations, ultimately leading to (almost) lossless representations, enabling sharp reconstructions. Furthermore, our model supports sample generation without input images, functioning as a standalone generative model. We evaluate our framework in terms of both disentanglement and generation quality. Additionally, we observe smooth transitions in the latent spaces with respect to changes in $β$, facilitating consistent manipulation of generated outputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。