提出稳定速度框架,让流匹配训练更稳、采样更快。
Stable Velocity: A Variance Perspective on Flow Matching
- 从方差视角改进流匹配,区分高低方差区域
- 训练效率提升,采样速度超2倍且质量不变
- 适配主流文生图/视频模型,无需微调
流匹配虽优雅,但依赖单样本条件速度导致高方差训练目标,引发优化不稳与收敛缓慢。我们通过显式分析该方差,发现:1)靠近先验时处于高方差区域,优化困难;2)靠近数据分布时为低方差区域,条件与边际速度几乎一致。基于此,提出统一框架Stable Velocity:训练端引入无偏方差减少的目标StableVM,及自适应强化辅助监督的VA-REPA;推理端利用低方差区域的闭式简化,实现无需微调的StableVS加速。在ImageNet $256 imes256$ 及SD3.5、Flux、Qwen-Image、Wan2.2等大模型上实验表明,训练效率提升,低方差区域内采样速度超过2倍,且样本质量无损。代码已开源。
原文摘要 · Abstract (English)
While flow matching is elegant, its reliance on single-sample conditional velocities leads to high-variance training targets that destabilize optimization and slow convergence. By explicitly characterizing this variance, we identify 1) a high-variance regime near the prior, where optimization is challenging, and 2) a low-variance regime near the data distribution, where conditional and marginal velocities nearly coincide. Leveraging this insight, we propose Stable Velocity, a unified framework that improves both training and sampling. For training, we introduce Stable Velocity Matching (StableVM), an unbiased variance-reduction objective, along with Variance-Aware Representation Alignment (VA-REPA), which adaptively strengthen auxiliary supervision in the low-variance regime. For inference, we show that dynamics in the low-variance regime admit closed-form simplifications, enabling Stable Velocity Sampling (StableVS), a finetuning-free acceleration. Extensive experiments on ImageNet $256\times256$ and large pretrained text-to-image and text-to-video models, including SD3.5, Flux, Qwen-Image, and Wan2.2, demonstrate consistent improvements in training efficiency and more than $2\times$ faster sampling within the low-variance regime without degrading sample quality. Our code is available at https://github.com/linYDTHU/StableVelocity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。