arXiv:2511.01419cs.CV2025-11被引 12

用自蒸馏加速视频生成,1-2步也能出高质量结果

Towards One-step Causal Video Generation via Adversarial Self-Distillation

  • 通过对抗性自蒸馏让模型在极少步骤内完成视频生成
  • 1步或2步生成效果超越当前最好方法,且训练更稳定
  • 一个模型支持多种推理步数,无需重复训练

近期混合视频生成模型结合自回归时序动态与基于扩散的逐像素去噪,但其迭代过程导致误差累积和推理时间长。本文提出一种基于蒸馏的因果视频生成框架,实现极低去噪步数下的高质量合成。基于分布匹配蒸馏(DMD)框架,提出新型对抗性自蒸馏(ASD)策略,将学生模型n步去噪输出与(n+1)步版本在分布层面对齐,通过弥合学生内部小差距提供更平滑监督,并融合教师知识与局部一致的学生行为,显著提升极少数步场景(如1-2步)下的训练稳定性与生成质量。此外,提出首帧增强(FFE)策略,为初始帧分配更多去噪步数以缓解误差传播,后继帧则采用更大跳步。VBench实验表明,本方法在单步和双步生成上均超越现有最优方案。值得注意的是,该框架可生成单一蒸馏模型,灵活支持多推理步设置,避免重复再蒸馏,实现高效高质量视频合成。

原文摘要 · Abstract (English)

Recent hybrid video generation models combine autoregressive temporal dynamics with diffusion-based spatial denoising, but their sequential, iterative nature leads to error accumulation and long inference times. In this work, we propose a distillation-based framework for efficient causal video generation that enables high-quality synthesis with extremely limited denoising steps. Our approach builds upon the Distribution Matching Distillation (DMD) framework and proposes a novel Adversarial Self-Distillation (ASD) strategy, which aligns the outputs of the student model's n-step denoising process with its (n+1)-step version at the distribution level. This design provides smoother supervision by bridging small intra-student gaps and more informative guidance by combining teacher knowledge with locally consistent student behavior, substantially improving training stability and generation quality in extremely few-step scenarios (e.g., 1-2 steps). In addition, we present a First-Frame Enhancement (FFE) strategy, which allocates more denoising steps to the initial frames to mitigate error propagation while applying larger skipping steps to later frames. Extensive experiments on VBench demonstrate that our method surpasses state-of-the-art approaches in both one-step and two-step video generation. Notably, our framework produces a single distilled model that flexibly supports multiple inference-step settings, eliminating the need for repeated re-distillation and enabling efficient, high-quality video synthesis.

视频生成扩散模型蒸馏高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。