arXiv:2605.26449cs.CVcs.AI2026-05

提出跨尺度对齐机制,让生成图像在多阶段保持一致轨迹。

Cross-scale Aligned Supervision for Training GANs

论文配图:Cross-scale Aligned Supervision for Training GANs
图 1 · 摘自论文原文
  • 用生成器侧一致性正则约束中间输出与最终输出对齐
  • 在ImageNet-256上仅用60轮训练即达FID 1.56
  • 适合追求高效高质图像生成的从业者

现代GAN常在生成器中间输出引入对抗性监督,并将其解释为从粗到细的层级生成。本文挑战这一观点:标准的分尺度对抗监督并未建立真正的粗到细层级——每个中间图像仅在自身分辨率下被推向真实分布,但不同阶段输出未必代表同一生成样本。此外,各阶段生成的图像未被明确用作后续阶段的细化目标,导致后期阶段可偏离先前样本轨迹。为此,提出CAT模型,在保持判别器分尺度结构的同时,加入生成器侧的一致性正则,使中间输出与最终输出对齐。在类条件ImageNet-256上,CAT-H/2仅经60轮训练,一步推理即达FID-50K 1.56,优于强基准方法。

原文摘要 · Abstract (English)

Modern GANs often introduce adversarial supervision on intermediate generator outputs and interpret the resulting multi-stage synthesis as coarse-to-fine hierarchical generation. In this work, we challenge this interpretation. We argue that standard scale-wise adversarial supervision does not construct a proper coarse-to-fine hierarchy: each intermediate image is independently pushed toward the real distribution at its own resolution, but this scale-wise realism does not ensure that outputs across stages represent the identical generated sample. Moreover, the scale-specific image produced at each stage is not used as an explicit refinement target for the subsequent stage. Therefore, its adversarial loss can improve a scale-specific output without constraining later stages to preserve the same sample trajectory, allowing them to move toward a different sample rather than refine the previous output. We refer to this problem as a cross-scale trajectory misalignment problem. To resolve it, we propose CAT, a Cross-scale Aligned Transformer for multi-scale adversarial generation. CAT keeps the discriminator scale-wise, so each intermediate output is evaluated at its own resolution, while adding a simple generator-side consistency regularization that aligns intermediate outputs with the final output. On class-conditional ImageNet-256, CAT-H/2 achieves an FID-50K of 1.56 with one-step inference after only 60 training epochs, outperforming strong one-step GAN and diffusion/flow baselines.

GAN图像生成跨尺度对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。