arXiv:2602.02214cs.CV2026-02被引 122

解决实时视频生成中自回归模型的性能下降问题,提升交互式视频质量。

Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation

  • 用自回归教师引导初始化,弥补因果注意力与双向注意力的架构差距。
  • 在动态度、视觉奖励等指标上超越当前最佳方法,最高提升19.3%。
  • 适合追求高质量实时交互视频生成的研究者与开发者。

为实现实时交互式视频生成,现有方法将预训练的双向视频扩散模型蒸馏为少步自回归(AR)模型,但在全注意力被因果注意力替代时面临架构鸿沟。现有方法通过微分方程(ODE)蒸馏初始化AR学生模型,要求帧级可逆性——即每个噪声帧在AR教师的PF-ODE下必须唯一映射到一个干净帧。然而,从双向教师蒸馏AR学生违反该条件,导致无法恢复教师流映射,转而诱导出条件期望解,降低性能。为此,本文提出Causal Forcing:使用自回归教师进行ODE初始化以弥合架构差距,并沿用Self Forcing中的相同扩散模型蒸馏(DMD)流程。实验表明,本方法在所有指标上均优于基线,相比最先进方法Self Forcing,在动态度上提升19.3%,视觉奖励提升8.7%,指令遵循能力提升16.7%。

原文摘要 · Abstract (English)

To achieve real-time interactive video generation, current methods distill pretrained bidirectional video diffusion models into few-step autoregressive (AR) models, facing an architectural gap when full attention is replaced by causal attention. However, existing approaches do not bridge this gap theoretically. They initialize the AR student via ODE distillation, which requires frame-level injectivity, where each noisy frame must map to a unique clean frame under the PF-ODE of an AR teacher. Distilling an AR student from a bidirectional teacher violates this condition, preventing recovery of the teacher's flow map and instead inducing a conditional-expectation solution, which degrades performance. To address this issue, we propose Causal Forcing, which uses an autoregressive teacher for ODE initialization to bridge the architectural gap, and then applies the same DMD procedure as in Self Forcing. Empirical results show that our method outperforms all baselines across all metrics, surpassing the SOTA Self Forcing by 19.3\% in Dynamic Degree, 8.7\% in VisionReward, and 16.7\% in Instruction Following. Project page: \href{https://thu-ml.github.io/CausalForcing.github.io/}{https://thu-ml.github.io/CausalForcing.github.io/}; the code: \href{https://github.com/thu-ml/Causal-Forcing}{https://github.com/thu-ml/Causal-Forcing}.

视频生成扩散模型自回归蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。