用对比学习提升单图超分真实感,减少幻觉伪影。
MaCo-GAN: Manifold-Contrastive Adversarial Learning for Single Image Super-Resolution

- 引入流形对比损失,替代传统对抗损失
- 生成多类逼真假图,增强模型判别能力
- 显著改善感知质量与失真平衡,适合图像重建任务
针对单图超分辨率(SISR)中生成幻觉伪影的问题,本文提出MaCo-GAN框架,将传统GAN的对抗损失替换为监督对比学习目标。核心是动态伪造样本生成器,将真实图像生成一系列保持低分辨率对应关系、但具有挑战性的逼真假图。在此基础上构建鲁棒的对比极小极大博弈:生成器被训练为将预测结果吸引至流形内假图(低失真),排斥至流形外假图(高失真),而判别器则执行相反优化。仅用该目标替换基线模型的对抗损失,便在多个基准上实现感知-失真权衡的持续改进。大量消融实验验证了方法有效性,并揭示了该条件对比博弈的内在机制。
原文摘要 · Abstract (English)
Conventional Generative Adversarial Networks (GANs) for Single Image Super-Resolution (SISR) often struggle with hallucinated artifacts, largely because standard discriminators evaluate overall image naturalness rather than strict conditional realism. To address this, we propose MaCo-GAN, a novel manifold-contrastive GAN framework that replaces the conventional adversarial loss with a supervised contrastive objective. A core component of our method is a dynamic fake sample synthesizer that transforms ground truth (GT) data into a spectrum of challenging, perceptually plausible fake images that strictly maintain low-resolution (LR) correspondence. Utilizing these synthesized samples, we establish a robust contrastive minimax game: the generator is trained to attract its predictions toward on-manifold fakes (low distortion) and repel them from off-manifold fakes (high distortion), while the discriminator optimizes the exact opposite. By simply replacing the adversarial loss of a baseline SR model with our proposed objective, we demonstrate consistent improvements in the perception-distortion trade-off across various benchmarks. Extensive ablation studies validate the effectiveness of our framework and provide deep insights into the dynamics of this conditional contrastive game.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。