统一视频生成的双向与自回归模式,兼顾质量与效率。
Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model

- 通过灵活分块机制,在时间轴和去噪步骤上动态调整生成策略。
- 在多数据集上实现更优画质与长视频稳定性,推理速度更快。
- 适合需要灵活生成、低延迟部署的视频生成场景。
大规模生成模型的进展显著推动了视频生成技术的发展,但现有方法受限于固定的推理范式。双向扩散模型虽能保持全局连贯性和视觉保真度,但推理缓慢;自回归模型虽支持高效流式生成,却存在长程一致性差和暴露偏差问题。本文提出 Flex-Forcing,一种统一的训练与推理框架,使视频扩散模型可在双向与自回归生成模式间无缝切换。核心思想是基于时间轴和去噪步骤的灵活分块机制,使模型能够(1)根据设备预算灵活分块;(2)跨块进行双向推理以规划全局结构,块内自回归生成以实现高效精细合成;(3)支持任意顺序、任意时间步的自回归生成,突破严格因果约束。在多个视频生成基准上的实验表明,Flex-Forcing 在保持更优视频质量与长视频稳定性的同时,显著提升推理速度,优于具有固定推理调度的强基线方法。
原文摘要 · Abstract (English)
Recent progress in large-scale generative models has substantially advanced video generation, yet existing methods remain constrained by a rigid inference paradigm. Bidirectional diffusion models excel at global coherence and visual fidelity but suffer from slow inference, while autoregressive models offer efficient and streaming generation at the cost of long-range consistency and exposure bias. We introduce Flex-Forcing, a unified training and inference framework that enables a video diffusion model to seamlessly operate under both bidirectional and autoregressive generation regimes. The core idea is a flexible chunking mechanism jointly defined over the temporal axis and denoising steps. This design allows the model to (1) perform flexible chunking according to different device budgets, (2) perform bidirectional inference across chunks for global structure planning, while generating frames autoregressively within each chunk for efficient and fine-grained synthesis, and (3) perform any-order, any-timestep autoregressive generation without the strict causal constraint. Extensive experiments on multiple video generation benchmarks demonstrate that Flex-Forcing achieves consistently better video quality, long-video stability than strong baselines with a rigid inference schedule, while offering faster inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。