arXiv:2501.11236cs.CVcs.LG2025-01

通过梯度约束提升生成多样性,稳定GAN训练

A New Formulation of Lipschitz Constrained With Functional Gradient Learning for GANs

  • 用ε中心梯度惩罚放大判别器梯度范数,控制潜在向量邻域大小
  • 实验证明该方法显著减少邻域尺寸,提升样本多样性
  • 适合关注GAN稳定性与生成质量的科研人员

本文提出一种新型的利普希茨约束功能梯度生成对抗网络学习方法(Li-CFG),用于在大规模数据集上稳定训练GAN并提供理论保障。传统GAN训练常因最小最大博弈导致不稳定性,并存在模式崩溃问题。为解决此问题,本文通过增大判别器梯度范数来减小潜在向量的邻域尺寸,从而提升生成样本多样性。为此,提出ε中心梯度惩罚,有效放大判别器梯度范数。相比其他约束方法,该方法使潜在向量邻域最小化,实现更强的稳定性与更丰富的样本多样性。在多个图像生成基准数据集上的实验验证了其有效性。

原文摘要 · Abstract (English)

This paper introduces a promising alternative method for training Generative Adversarial Networks (GANs) on large-scale datasets with clear theoretical guarantees. GANs are typically learned through a minimax game between a generator and a discriminator, which is known to be empirically unstable. Previous learning paradigms have encountered mode collapse issues without a theoretical solution. To address these challenges, we propose a novel Lipschitz-constrained Functional Gradient GANs learning (Li-CFG) method to stabilize the training of GAN and provide a theoretical foundation for effectively increasing the diversity of synthetic samples by reducing the neighborhood size of the latent vector. Specifically, we demonstrate that the neighborhood size of the latent vector can be reduced by increasing the norm of the discriminator gradient, resulting in enhanced diversity of synthetic samples. To efficiently enlarge the norm of the discriminator gradient, we introduce a novel ε-centered gradient penalty that amplifies the norm of the discriminator gradient using the hyper-parameter ε. In comparison to other constraints, our method enlarging the discriminator norm, thus obtaining the smallest neighborhood size of the latent vector. Extensive experiments on benchmark datasets for image generation demonstrate the efficacy of the Li-CFG method and the ε-centered gradient penalty. The results showcase improved stability and increased diversity of synthetic samples.

GAN生成模型梯度惩罚

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。