arXiv:2509.24526cs.CVcs.AI2025-09被引 20

提出中段训练法,让图像生成模型更快更稳地学习长跳步路径。

CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Models

  • 在预训练与最终训练间加入轻量中间阶段,直接学习解轨迹上的点映射。
  • 两步生成在CIFAR-10上FID达1.97,训练数据和时间减少98%。
  • 适合追求高效、稳定训练的生成模型研究者与开发者。

流图模型如一致性模型(CM)和均流(MF)通过学习扩散模型微分方程解的长跳步实现少步生成,但训练不稳定、对超参数敏感且成本高。从预训练扩散模型初始化虽有帮助,但仍需将无穷小步转换为长跳步映射,无法解决不稳定性。本文提出中段训练(CMT),首次引入在(扩散)预训练与最终流图训练之间插入一个轻量级中间阶段的实用方法。具体而言,一致性中段训练(CMT)是一个紧凑而原理明确的阶段,使模型从先验样本出发,直接学习到求解器生成的干净样本的轨迹点映射。该过程提供轨迹一致且稳定的初始化。此初始化优于随机和基于扩散的基线,可实现无需启发式策略的快速稳健收敛。使用CMT权重初始化后训练进一步简化了流图学习。实证表明,CMT在两步生成上达到当前最优:CIFAR-10上FID 1.97,ImageNet 64x64上1.32,512x512上1.84,训练数据和GPU时间相比CM最多减少98%。在ImageNet 256x256上,CMT实现单步生成FID 3.34,总训练时间比从零开始的MF减少约50%(原为3.43)。这确立了CMT作为训练流图模型的一种原则性、高效且通用的框架。

原文摘要 · Abstract (English)

Flow map models such as Consistency Models (CM) and Mean Flow (MF) enable few-step generation by learning the long jump of the ODE solution of diffusion models, yet training remains unstable, sensitive to hyperparameters, and costly. Initializing from a pre-trained diffusion model helps, but still requires converting infinitesimal steps into a long-jump map, leaving instability unresolved. We introduce mid-training, the first concept and practical method that inserts a lightweight intermediate stage between the (diffusion) pre-training and the final flow map training (i.e., post-training) for vision generation. Concretely, Consistency Mid-Training (CMT) is a compact and principled stage that trains a model to map points along a solver trajectory from a pre-trained model, starting from a prior sample, directly to the solver-generated clean sample. It yields a trajectory-consistent and stable initialization. This initializer outperforms random and diffusion-based baselines and enables fast, robust convergence without heuristics. Initializing post-training with CMT weights further simplifies flow map learning. Empirically, CMT achieves state of the art two step FIDs: 1.97 on CIFAR-10, 1.32 on ImageNet 64x64, and 1.84 on ImageNet 512x512, while using up to 98% less training data and GPU time, compared to CMs. On ImageNet 256x256, CMT reaches 1-step FID 3.34 while cutting total training time by about 50% compared to MF from scratch (FID 3.43). This establishes CMT as a principled, efficient, and general framework for training flow map models.

生成模型一致性模型高效训练扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。