arXiv:2602.03039cs.CV2026-02中稿 · manuscript

用预训练网络提升GAN生成质量,通过自监督与判别器一致性实现更优图像多样性。

HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency

  • 引入FakeTwins自监督损失,利用预训练网络增强生成器
  • 设计跨CNN与ViT判别器的一致性机制,提升训练稳定性
  • 在17个数据集上显著优于现有方法,尤其在小样本场景下表现突出

生成对抗网络(GAN)在图像生成质量方面取得了显著进展。近期方法常借助预训练网络计算感知损失或使用其特征空间。本文提出HP-GAN,通过创新的自监督学习技术并强化判别器间的结构一致性,进一步拓展预训练网络的能力。核心策略包括:以预训练网络为编码器构建自监督损失,应用于生成图像以训练生成器,从而提升图像多样性和质量;同时引入对齐卷积神经网络(CNN)与视觉变换器(ViT)特征空间判别器的一致性机制,促进判别器间协同学习,增强训练鲁棒性。在十七个数据集上的广泛评估表明,涵盖大、小及有限数据场景,且覆盖多种图像领域,HP-GAN在弗雷谢特初始距离(FID)指标上持续超越当前最优方法,显著提升图像质量和多样性。代码已开源:https://github.com/higun2/HP-GAN。

原文摘要 · Abstract (English)

Generative Adversarial Networks (GANs) have made significant progress in enhancing the quality of image synthesis. Recent methods frequently leverage pretrained networks to calculate perceptual losses or utilize pretrained feature spaces. In this paper, we extend the capabilities of pretrained networks by incorporating innovative self-supervised learning techniques and enforcing consistency between discriminators during GAN training. Our proposed method, named HP-GAN, effectively exploits neural network priors through two primary strategies: FakeTwins and discriminator consistency. FakeTwins leverages pretrained networks as encoders to compute a self-supervised loss and applies this through the generated images to train the generator, thereby enabling the generation of more diverse and high quality images. Additionally, we introduce a consistency mechanism between discriminators that evaluate feature maps extracted from Convolutional Neural Network (CNN) and Vision Transformer (ViT) feature networks. Discriminator consistency promotes coherent learning among discriminators and enhances training robustness by aligning their assessments of image quality. Our extensive evaluation across seventeen datasets-including scenarios with large, small, and limited data, and covering a variety of image domains-demonstrates that HP-GAN consistently outperforms current state-of-the-art methods in terms of Fréchet Inception Distance (FID), achieving significant improvements in image diversity and quality. Code is available at: https://github.com/higun2/HP-GAN.

GAN预训练自监督图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。