用判别器精修生成模型,提升泛化能力
Seasoning Generative Models for a Generalization Aftertaste
- 基于f散度对偶性设计判别器引导的精修方法
- 精修后模型泛化误差显著降低,与判别器复杂度相关
- 为扩散模型等方法提供理论支持,适合研究者参考
利用判别器训练或微调生成模型已被证明是有效的框架。代表性工作包括生成对抗网络(GANs),其通过训练判别器最小化损失,以及满足弱学习者约束的判别器驱动范式。近期,扩散模型也展现出判别器引导的优势。本文扩展了与f散度相关的强对偶性结果,提出一种通用的判别器引导精修方法,可对任意生成模型进行优化。分析表明,经精修的模型在泛化性能上优于未精修版本,且泛化差距的改善程度取决于用于精修的判别器集合的Rademacher复杂度。该方法涵盖最近提出的基于得分的扩散方法(Kim et al., 2022),并为其提供了理论解释,揭示了其泛化保障。本工作不仅验证了现有方法的理论基础,还启发新算法设计,并深化了对生成模型泛化机制的理解。
原文摘要 · Abstract (English)
The use of discriminators to train or fine-tune generative models has proven to be a rather successful framework. A notable example is Generative Adversarial Networks (GANs) that minimize a loss incurred by training discriminators along with other paradigms that boost generative models via discriminators that satisfy weak learner constraints. More recently, even diffusion models have shown advantages with some kind of discriminator guidance. In this work, we extend a strong-duality result related to $f$-divergences which gives rise to a discriminator-guided recipe that allows us to \textit{refine} any generative model. We then show that the refined generative models provably improve generalization, compared to its non-refined counterpart. In particular, our analysis reveals that the gap in generalization is improved based on the Rademacher complexity of the discriminator set used for refinement. Our recipe subsumes a recently introduced score-based diffusion approach (Kim et al., 2022) that has shown great empirical success, however allows us to shed light on the generalization guarantees of this method by virtue of our analysis. Thus, our work provides a theoretical validation for existing work, suggests avenues for new algorithms, and contributes to our understanding of generalization in generative models at large.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。