arXiv:2602.11105cs.CV2026-02中稿 · ICLR被引 3

通过强化学习动态跳过冗余步骤,让生成模型提速超2.6倍。

FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference

  • 用有限差分预估未来状态,跳过部分计算步骤。
  • 在保持画质前提下实现2.6倍以上加速。
  • 适配图像、视频生成与编辑,无需重新训练。

流匹配模型在图像和视频生成中表现优异,但其固有的逐步去噪过程导致速度较慢。现有加速方法如知识蒸馏、轨迹截断和一致性方法均为静态策略,需重新训练且难以跨任务泛化。本文提出FastFlow,一种即插即用的自适应推理框架,可在不牺牲质量的前提下加速流匹配模型生成。该方法识别对去噪路径影响极小的步骤,并利用先前预测的有限差分速度估计来高效外推未来状态,从而在零计算成本下实现路径快速推进,允许跳过中间步骤。将跳过步数的决策建模为多臂赌博机问题,带智能学习最优跳步策略以平衡速度与性能。FastFlow可无缝集成至现有流程,在图像生成、视频生成及编辑任务中均表现良好。实验表明,相比基线模型实现超过2.6倍的加速,同时保持高质量输出。代码已开源:https://github.com/Div290/FastFlow。

原文摘要 · Abstract (English)

Flow-matching models deliver state-of-the-art fidelity in image and video generation, but the inherent sequential denoising process renders them slower. Existing acceleration methods like distillation, trajectory truncation, and consistency approaches are static, require retraining, and often fail to generalize across tasks. We propose FastFlow, a plug-and-play adaptive inference framework that accelerates generation in flow matching models. FastFlow identifies denoising steps that produce only minor adjustments to the denoising path and approximates them without using the full neural network models used for velocity predictions. The approximation utilizes finite-difference velocity estimates from prior predictions to efficiently extrapolate future states, enabling faster advancements along the denoising path at zero compute cost. This enables skipping computation at intermediary steps. We model the decision of how many steps to safely skip before requiring a full model computation as a multi-armed bandit problem. The bandit learns the optimal skips to balance speed with performance. FastFlow integrates seamlessly with existing pipelines and generalizes across image generation, video generation, and editing tasks. Experiments demonstrate a speedup of over 2.6x while maintaining high-quality outputs. The source code for this work can be found at https://github.com/Div290/FastFlow.

生成模型加速推理流匹配强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。