提出滚动强制方法,实现单卡实时生成多分钟无误差累积长视频。
Rolling Forcing: Autoregressive Long Video Diffusion in Real Time

- 联合去噪:同时处理多帧,逐步增加噪声水平,缓解误差传播。
- 引入注意力锚点,保持初始帧全局上下文,提升长期一致性。
- 少步蒸馏训练,非重叠窗口设计,减少自生成历史偏差。
流式视频生成是交互式世界模型和神经游戏引擎的核心组件,旨在生成高质量、低延迟且时序连贯的长视频流。然而,现有方法普遍存在严重误差累积问题,导致长序列生成质量显著下降。本文提出滚动强制(Rolling Forcing)技术,有效抑制长视频流中的误差积累。该方法包含三项创新:首先,采用联合去噪机制,同时对多帧进行去噪,并逐步提高噪声水平,弱化相邻帧间的严格因果关系,从而抑制误差增长;其次,将注意力锚点机制引入长时序视频生成任务,使模型可保留初始帧的关键值状态作为全局上下文锚点,增强长期一致性;第三,设计高效训练算法,在大幅扩展的去噪窗口上实现少步蒸馏,基于非重叠窗口运行,缓解依赖自生成历史带来的暴露偏差。大量实验表明,滚动强制可在单张GPU上实现实时生成多分钟长视频,显著降低误差累积。
原文摘要 · Abstract (English)
Streaming video generation, as one fundamental component in interactive world models and neural game engines, aims to generate high-quality, low-latency, and temporally coherent long video streams. However, most existing work suffers from severe error accumulation that often significantly degrades the generated stream videos over long horizons. We design Rolling Forcing, a novel video generation technique that enables streaming long videos with minimal error accumulation. Rolling Forcing comes with three novel designs. First, instead of iteratively sampling individual frames, which accelerates error propagation, we design a joint denoising scheme that simultaneously denoises multiple frames with progressively increasing noise levels. This design relaxes the strict causality across adjacent frames, effectively suppressing error growth. Second, we introduce the attention sink mechanism into the long-horizon stream video generation task, which allows the model to keep key value states of initial frames as a global context anchor and thereby enhances long-term global consistency. Third, we design an efficient training algorithm that enables few-step distillation over largely extended denoising windows. This algorithm operates on non-overlapping windows and mitigates exposure bias conditioned on self-generated histories. Extensive experiments show that Rolling Forcing enables real-time streaming generation of multi-minute videos on a single GPU, with substantially reduced error accumulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。