无需训练即可加速流匹配生成,提升2.5倍速度且不降质。
FlowCast: Trajectory Forecasting for Scalable Zero-Cost Speculative Flow Matching
- 利用恒定速度先验推测未来轨迹,零成本跳过冗余步骤。
- 在图像、视频生成与编辑中实现>2.5倍加速,质量无损。
- 兼容任意流匹配模型,无需额外网络或重训练。
流匹配(Flow Matching, FM)近期成为高质量视觉生成的强大方法,但其因需大量去噪步骤导致推理速度极慢,限制了实时或交互式应用。现有加速方法如蒸馏、截断或一致性训练,或降低质量,或需高成本重训练,或缺乏泛化性。本文提出FlowCast,一种无需训练的推测生成框架,利用FM模型训练中保持恒定速度的特性,通过外推当前速度推测未来状态,若误差在均方误差阈值内则接受。该恒速预测使稳定区域可大幅跳步,复杂区域仍保持精度。FlowCast为即插即用框架,可无缝集成于任意FM模型,无需辅助网络。我们还进行了理论分析,给出了推测轨迹与完整FM轨迹之间的最坏偏差边界。实验表明,FlowCast在图像生成、视频生成与编辑任务中均实现>2.5倍加速,优于现有基线,且无质量损失。
原文摘要 · Abstract (English)
Flow Matching (FM) has recently emerged as a powerful approach for high-quality visual generation. However, their prohibitively slow inference due to a large number of denoising steps limits their potential use in real-time or interactive applications. Existing acceleration methods, like distillation, truncation, or consistency training, either degrade quality, incur costly retraining, or lack generalization. We propose FlowCast, a training-free speculative generation framework that accelerates inference by exploiting the fact that FM models are trained to preserve constant velocity. FlowCast speculates future velocity by extrapolating current velocity without incurring additional time cost, and accepts it if it is within a mean-squared error threshold. This constant-velocity forecasting allows redundant steps in stable regions to be aggressively skipped while retaining precision in complex ones. FlowCast is a plug-and-play framework that integrates seamlessly with any FM model and requires no auxiliary networks. We also present a theoretical analysis and bound the worst-case deviation between speculative and full FM trajectories. Empirical evaluations demonstrate that FlowCast achieves $>2.5\times$ speedup in image generation, video generation, and editing tasks, outperforming existing baselines with no quality loss as compared to standard full generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。