提出新型训练方案,让生成对抗网络生成更高质量、更多样化的图像。
Nested Annealed Training Scheme for Generative Adversarial Networks
- 基于分数模型理论,推导出判别器最优梯度的数学形式。
- 新方法在多个数据集上显著提升生成图像质量和多样性。
- 适用于主流GAN架构,无需修改结构或损失函数。
近年来,生成对抗网络(GAN)等深度生成模型取得了显著进展。尽管其在实践中表现优异,但其数学基础仍不清晰。本文聚焦于复合函数梯度生成对抗网络(CFG),揭示其与基于分数的模型之间的理论联系:CFG判别器的训练目标等价于寻找最优D(x),其梯度对应真实与生成样本分数函数差异的积分;而生成器的训练则旨在最小化该差异。为此,本文推导出一种前馈退火权重,形成退火式CFG方法。为克服该方法难以适配当前主流GAN的问题,提出嵌套退火训练方案(NATS),保留退火权重并可无缝集成至不同结构、损失或正则化的GAN模型中。在多个基准图像生成数据集上的实验表明,退火CFG与NATS显著提升了生成样本的质量与多样性,优于原有CFG方法及当前先进GAN模型。
原文摘要 · Abstract (English)
Recently, researchers have proposed many deep generative models, including generative adversarial networks(GANs) and denoising diffusion models. Although significant breakthroughs have been made and empirical success has been achieved with the GAN, its mathematical underpinnings remain relatively unknown. This paper focuses on a rigorous mathematical theoretical framework: the composite-functional-gradient GAN (CFG)[1]. Specifically, we reveal the theoretical connection between the CFG model and score-based models. We find that the training objective of the CFG discriminator is equivalent to finding an optimal D(x). The optimal gradient of D(x) differentiates the integral of the differences between the score functions of real and synthesized samples. Conversely, training the CFG generator involves finding an optimal G(x) that minimizes this difference. In this paper, we aim to derive an annealed weight preceding the weight of the CFG discriminator. This new explicit theoretical explanation model is called the annealed CFG method. To overcome the limitation of the annealed CFG method, as the method is not readily applicable to the SOTA GAN model, we propose a nested annealed training scheme (NATS). This scheme keeps the annealed weight from the CFG method and can be seamlessly adapted to various GAN models, no matter their structural, loss, or regularization differences. We conduct thorough experimental evaluations on various benchmark datasets for image generation. The results show that our annealed CFG and NATS methods significantly improve the quality and diversity of the synthesized samples. This improvement is clear when comparing the CFG method and the SOTA GAN models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。