无需判别器的单步图像生成方法,速度与质量兼得
Self-Adversarial One Step Generation via Condition Shifting
- 通过条件转移提取内在对抗信号,替代外部判别器
- 0.6B模型单步生成质量超越12B模型,推理提速15.33倍
- 兼容全参数与LoRA微调,6小时完成高效训练
为提升文本到图像生成效率,研究向单步采样发展,但现有方法仍面临保真度、推理速度与训练效率三者间的权衡。依赖外部判别器的方法虽能提升性能,却常导致训练不稳定、显存开销大、收敛慢,难以扩展和参数高效调优。基于回归的蒸馏与一致性目标优化更稳定,但在单步约束下易丢失细节。本文提出APEX,基于关键理论洞察:通过条件转移可从流模型中内生提取对抗校正信号。利用变换构建偏移条件分支,其速度场作为当前生成分布的独立估计器,产生可证明与GAN对齐的梯度,取代易引发梯度消失的样本相关判别项。该无判别器设计保持架构兼容性,支持全参数与LoRA调优。实验表明,0.6B模型在单步生成质量上超越FLUX-Schnell 12B(20×更多参数);在Qwen-Image 20B上使用LoRA微调,仅用6小时即达GenEval 0.89(NFE=1),超过原50步教师模型(0.87),实现15.33×推理加速。
原文摘要 · Abstract (English)
The push for efficient text to image synthesis has moved the field toward one step sampling, yet existing methods still face a three way tradeoff among fidelity, inference speed, and training efficiency. Approaches that rely on external discriminators can sharpen one step performance, but they often introduce training instability, high GPU memory overhead, and slow convergence, which complicates scaling and parameter efficient tuning. In contrast, regression based distillation and consistency objectives are easier to optimize, but they typically lose fine details when constrained to a single step. We present APEX, built on a key theoretical insight: adversarial correction signals can be extracted endogenously from a flow model through condition shifting. Using a transformation creates a shifted condition branch whose velocity field serves as an independent estimator of the model's current generation distribution, yielding a gradient that is provably GAN aligned, replacing the sample dependent discriminator terms that cause gradient vanishing. This discriminator free design is architecture preserving, making APEX a plug and play framework compatible with both full parameter and LoRA based tuning. Empirically, our 0.6B model surpasses FLUX-Schnell 12B (20$\times$ more parameters) in one step quality. With LoRA tuning on Qwen-Image 20B, APEX reaches a GenEval score of 0.89 at NFE=1 in 6 hours, surpassing the original 50-step teacher (0.87) and providing a 15.33$\times$ inference speedup. Code is available https://github.com/LINs-lab/APEX.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。