arXiv:2512.05150cs.CV2025-12中稿 · ICLR被引 16

TwinFlow让大模型1步生成,效率提升100倍且不损失质量。

TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flows

  • 用自对抗流机制训练单步生成模型,无需预训练教师模型或对抗网络。
  • 1步生成在GenEval上达0.83分,超越SANA-Sprint和RCGM等强基线。
  • 可扩展至200亿参数模型,1步推理成本仅为原模型的1%。

大型多模态生成模型虽在图像与视频生成中表现优异,但通常依赖扩散或流匹配等多步框架,推理效率低(需40-100次函数评估)。现有少步方法存在局限:基于蒸馏的方法需迭代训练或在极少数步骤(<4次)时性能下降;引入对抗训练的方案(如DMD/DMD2、SANA-Sprint)则带来训练不稳定、复杂度高及显存开销大的问题。为此,我们提出TwinFlow,一种简单高效的1步生成训练框架,无需固定预训练教师模型,训练中也不使用标准对抗网络,适合构建大规模高效生成模型。在文本到图像任务中,本方法仅用1次函数评估(1-NFE)即达到GenEval得分0.83,优于基于GAN损失的SANA-Sprint和一致性框架RCGM。特别地,我们在Qwen-Image-20B上实现全参数训练,并将其转化为高效少步生成器:仅1次评估即可达到原始100次评估模型在GenEval与DPG-Bench上的性能,计算成本降低100倍,质量损失轻微。项目主页见https://zhenglin-cheng.com/twinflow。

原文摘要 · Abstract (English)

Recent advances in large multi-modal generative models have demonstrated impressive capabilities in multi-modal generation, including image and video generation. These models are typically built upon multi-step frameworks like diffusion and flow matching, which inherently limits their inference efficiency (requiring 40-100 Number of Function Evaluations (NFEs)). While various few-step methods aim to accelerate the inference, existing solutions have clear limitations. Prominent distillation-based methods, such as progressive and consistency distillation, either require an iterative distillation procedure or show significant degradation at very few steps (< 4-NFE). Meanwhile, integrating adversarial training into distillation (e.g., DMD/DMD2 and SANA-Sprint) to enhance performance introduces training instability, added complexity, and high GPU memory overhead due to the auxiliary trained models. To this end, we propose TwinFlow, a simple yet effective framework for training 1-step generative models that bypasses the need of fixed pretrained teacher models and avoids standard adversarial networks during training, making it ideal for building large-scale, efficient models. On text-to-image tasks, our method achieves a GenEval score of 0.83 in 1-NFE, outperforming strong baselines like SANA-Sprint (a GAN loss-based framework) and RCGM (a consistency-based framework). Notably, we demonstrate the scalability of TwinFlow by full-parameter training on Qwen-Image-20B and transform it into an efficient few-step generator. With just 1-NFE, our approach matches the performance of the original 100-NFE model on both the GenEval and DPG-Bench benchmarks, reducing computational cost by $100\times$ with minor quality degradation. Project page is available at https://zhenglin-cheng.com/twinflow.

生成模型单步生成效率优化扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。