自适应学习数据流形维度,提升生成质量
Adaptive Learning of the Latent Space of Wasserstein Generative Adversarial Networks
- 融合Wasserstein GAN与AE,通过改进的先验分布自适应学习隐空间维度
- 理论证明估计维数一致收敛于真实流形维数,且泛化误差有上界
- 实验验证可准确识别维度并生成高质量合成数据,适合流形结构复杂的数据
基于潜在变量的生成模型(如GAN和VAE)在多个领域表现出色。然而,自然图像等数据通常不分布在欧几里得空间中,而是位于低维流形上。若潜在维度选择不当,将无法揭示数据结构,导致潜在表示失配和生成质量下降。为此,本文提出一种新框架——潜在Wasserstein GAN(LWGAN),融合Wasserstein自编码器与Wasserstein GAN,通过改进的信息性潜在分布自适应学习数据流形的内在维度。我们证明存在编码器与生成器,使得学习到的编码分布维度等于数据流形维度。理论上建立估计维度的一致性,并给出LWGAN泛化误差的上界,表明从总体上强制合成数据分布与真实数据分布相似。大量实验证实,LWGAN能在多种场景下准确识别正确内在维度,并通过采样生成高质量合成数据。
原文摘要 · Abstract (English)
Generative models based on latent variables, such as generative adversarial networks (GANs) and variational auto-encoders (VAEs), have gained lots of interests due to their impressive performance in many fields. However, many data such as natural images usually do not populate the ambient Euclidean space but instead reside in a lower-dimensional manifold. Thus an inappropriate choice of the latent dimension fails to uncover the structure of the data, possibly resulting in mismatch of latent representations and poor generative qualities. Towards addressing these problems, we propose a novel framework called the latent Wasserstein GAN (LWGAN) that fuses the Wasserstein auto-encoder and the Wasserstein GAN so that the intrinsic dimension of the data manifold can be adaptively learned by a modified informative latent distribution. We prove that there exist an encoder network and a generator network in such a way that the intrinsic dimension of the learned encoding distribution is equal to the dimension of the data manifold. We theoretically establish that our estimated intrinsic dimension is a consistent estimate of the true dimension of the data manifold. Meanwhile, we provide an upper bound on the generalization error of LWGAN, implying that we force the synthetic data distribution to be similar to the real data distribution from a population perspective. Comprehensive empirical experiments verify our framework and show that LWGAN is able to identify the correct intrinsic dimension under several scenarios, and simultaneously generate high-quality synthetic data by sampling from the learned latent distribution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。