EFlow让视频生成训练更快更省,只需几步就能出高质量结果。
EFlow: Fast Few-Step Video Generator Training from Scratch via Efficient Solution Flow
- 用解流目标+动态注意力机制减少每步计算量
- 训练效率提升2.5倍,推理延迟降低45.3倍
- 适合追求高效训练与低延迟生成的开发者
视频扩散模型的扩展受限于双重成本:每步注意力的二次复杂度和迭代采样步数。本文提出EFlow,一种高效的少步训练框架,同时解决这两个瓶颈。为减少采样步数,采用解流目标学习从时间t的噪声状态映射到时间s的函数。为使该方法在视频规模下计算可行且质量高,提出两项互补创新:一是门控局部-全局注意力(Gated Local-Global Attention),一种可随机丢弃令牌的混合模块,高效、表达力强,且在极端随机丢弃下仍稳定,显著降低每步计算量;二是设计高效的少步训练方案,提出路径丢弃引导训练(Path-Drop Guided training),以低成本弱路径替代昂贵的指导目标;并引入均速度可加正则化(Mean-Velocity Additivity regularizer),确保极低步数下的高保真度。整体上,EFlow实现了可落地的从零训练流程,在Kinetics及大规模文本到视频数据集上表现媲美主流模型,训练吞吐量比标准解流方法高2.5倍,推理延迟比标准迭代模型低45.3倍。
原文摘要 · Abstract (English)
Scaling video diffusion transformers is fundamentally bottlenecked by two compounding costs: the expensive quadratic complexity of attention per step, and the iterative sampling steps. In this work, we propose EFlow, an efficient few-step training framework, that tackles these bottlenecks simultaneously. To reduce sampling steps, we build on a solution-flow objective that learns a function mapping a noised state at time t to time s. Making this formulation computationally feasible and high-quality at video scale, however, demands two complementary innovations. First, we propose Gated Local-Global Attention, a token-droppable hybrid block which is efficient, expressive, and remains highly stable under aggressive random token-dropping, substantially reducing per-step compute. Second, we develop an efficient few-step training recipe. We propose Path-Drop Guided training to replace the expensive guidance target with a computationally cheap, weak path. Furthermore, we augment this with a Mean-Velocity Additivity regularizer to ensure high fidelity at extremely low step counts. Together, our EFlow enables a practical from-scratch training pipeline, achieving up to 2.5x higher training throughput over standard solution-flow, and 45.3x lower inference latency than standard iterative models with competitive performance on Kinetics and large-scale text-to-video datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。