改进生成对抗网络的进化策略,提升半监督学习效果
Generate more than one child in your co-evolutionary semi-supervised learning GAN
- 采用无结构种群与精英保留机制,每代生成多个后代
- 在三个标准数据集上表现优于经典SSL-GAN方法
- 适合对半监督学习中生成模型优化感兴趣的读者
生成对抗网络(GAN)因其生成与真实数据相似样本的能力,在半监督学习(SSL)中表现出色,该方法称为SSL-GAN,近年来受到广泛关注。进化算法成功用于指导SSL-GAN的训练与演化,尤其在共演化框架中,将生成器与判别器分别置于独立种群中进行进化。现有共演化方法依赖细胞进化算法的空间结构,每代仅生成一个个体,并采用世代替换策略。本文重新审视这些设计选择,提出一种新的共演化方法——共演化精英型半监督GAN(CE-SSLGAN),采用随机交配种群、精英保留策略,并允许每代生成多个后代。在三个标准基准数据集上的实验表明,增加后代数量并引入精英保留可显著提升性能,优于传统SSL-GAN。
原文摘要 · Abstract (English)
Generative Adversarial Networks (GANs) are very useful methods to address semi-supervised learning (SSL) datasets, thanks to their ability to generate samples similar to real data. This approach, called SSL-GAN has attracted many researchers in the last decade. Evolutionary algorithms have been used to guide the evolution and training of SSL-GANs with great success. In particular, several co-evolutionary approaches have been applied where the two networks of a GAN (the generator and the discriminator) are evolved in separate populations. The co-evolutionary approaches published to date assume some spatial structure of the populations, based on the ideas of cellular evolutionary algorithms. They also create one single individual per generation and follow a generational replacement strategy in the evolution. In this paper, we re-consider those algorithmic design decisions and propose a new co-evolutionary approach, called Co-evolutionary Elitist SSL-GAN (CE-SSLGAN), with panmictic population, elitist replacement, and more than one individual in the offspring. We evaluate the performance of our proposed method using three standard benchmark datasets. The results show that creating more than one offspring per population and using elitism improves the results in comparison with a classical SSL-GAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。