arXiv:2605.15141cs.CV2026-05被引 21

提出Causal Forcing++,实现毫秒级视频实时生成。

Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation

论文配图:Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
图 1 · 摘自论文原文
  • 用因果一致性蒸馏初始化少步自回归模型,提升生成效率。
  • 2步帧级生成比现有4步方法质量更高,延迟降低50%。
  • 适合实时交互视频生成,尤其对算力敏感场景友好。

实时交互视频生成需低延迟、流式输出与可控生成。现有自回归扩散蒸馏方法在4步分块设置下表现优异,但受限于响应粒度粗和采样延迟高。本文探索更激进的设置:仅1-2步采样且帧级自回归。发现少步自回归模型的初始化是关键瓶颈,现有方法或目标错位、无法支持少步生成,或成本过高。提出Causal Forcing++,采用因果一致性蒸馏(causal CD)进行高效初始化。该方法学习与因果ODE蒸馏相同的条件流映射,但仅需相邻时间步间的单步在线教师引导,无需预计算并存储完整PF-ODE轨迹。此策略显著提升效率与可优化性。所提方法在帧级2步设置下,优于当前最优4步分块方法:VBench总分提升0.1,质量分+0.3,VisionReward+0.335;首帧延迟减少50%,第二阶段训练成本降低约4倍。进一步扩展至行动条件世界模型生成,延续Genie3思想。

原文摘要 · Abstract (English)

Real-time interactive video generation requires low-latency, streaming, and controllable rollout. Existing autoregressive (AR) diffusion distillation methods have achieved strong results in the chunk-wise 4-step regime by distilling bidirectional base models into few-step AR students, but they remain limited by coarse response granularity and non-negligible sampling latency. In this paper, we study a more aggressive setting: frame-wise autoregression with only 1--2 sampling steps. In this regime, we identify the initialization of a few-step AR student as the key bottleneck: existing strategies are either target-misaligned, incapable of few-step generation, or too costly to scale. We propose \textbf{Causal Forcing++}, a principled and scalable pipeline that uses \emph{causal consistency distillation} (causal CD) for few-step AR initialization. The core idea is that causal CD learns the same AR-conditional flow map as causal ODE distillation, but obtains supervision from a single online teacher ODE step between adjacent timesteps, avoiding the need to precompute and store full PF-ODE trajectories. This makes the initialization both more efficient and easier to optimize. The resulting pipeline, \ours, surpasses the SOTA 4-step chunk-wise Causal Forcing under the \textit{\textbf{frame-wise 2-step setting}} by 0.1 in VBench Total, 0.3 in VBench Quality, and 0.335 in VisionReward, while reducing first-frame latency by 50\% and Stage 2 training cost by $\sim$$4\times$. We further extend the pipeline to action-conditioned world model generation in the spirit of Genie3. Project Page: https://github.com/thu-ml/Causal-Forcing and https://github.com/shengshu-ai/minWM .

视频生成扩散模型实时生成蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。