arXiv:2607.26811cs.CV2026-07被引 2

提出联合蒸馏方法,提升自回归视频生成的多样性与覆盖度。

DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillation

论文配图:DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillation
图 1 · 摘自论文原文
  • 通过分布对齐评估,发现初始模型需覆盖目标分布模式而非仅追求画质。
  • 联合蒸馏同时优化模式寻找与模式覆盖,显著提升生成多样性与覆盖率。
  • 在小模型教师下仍超越大模型基线,适合注重生成多样性的场景。

现有自回归视频蒸馏方法通常采用基于分布匹配蒸馏(DMD)的多阶段流程,但常将初始化与DMD阶段解耦,导致两者追求不同目标分布,且主要依赖VBench等视觉评分评估中间学生模型。本文从分布视角重新审视这一设计:由于分布匹配损失具有模式寻找特性,良好初始化应匹配目标教师的模式覆盖范围,而非仅追求高质量。为此,我们引入分布评估协议,在共享隐空间中量化学生与教师分布的精确度与覆盖度,揭示了视觉评分难以发现的问题——部分初始化虽精度高但覆盖低,影响后续优化;而具备模式覆盖能力的初始化能保持更广支持区域。此外,即使目标分布对齐,DMD的反向KL目标在训练后期仍会引导学生趋向教师高概率区域,降低覆盖度与多样性。为此,我们提出联合蒸馏,结合DMD的模式寻找目标与一致性蒸馏的模式覆盖约束。实验表明,本方法显著提升生成质量、覆盖度与多样性;尤其使用Wan-1.3B DMD教师时,仍优于使用Wan-14B教师的基线,凸显分布对齐在自回归视频蒸馏中的关键作用。

原文摘要 · Abstract (English)

Existing autoregressive video distillation methods commonly adopt a Distribution Matching Distillation (DMD)-based multi-stage pipeline. However, they typically decouple the initialization and DMD stages -- which then pursue different target distributions -- and judge the intermediate student mainly by visual scores such as VBench. In this paper, we revisit this design from a distributional perspective. Given the mode-seeking nature of the distribution matching loss, a good initialization should match the mode coverage of the target DMD teacher, rather than merely pursuing high quality. To analyze this, we introduce a distributional evaluation protocol that measures precision and coverage between student and teacher distributions in a shared latent space. It exposes differences hidden by visual scores: some initializations reach high precision but low coverage, leading to suboptimal refinement, while mode-covering ones preserve broader support. Furthermore, even when the target distributions are aligned, DMD's reverse-KL objective can still drive the student toward high-probability teacher regions in late training, reducing coverage and diversity. To address this, we propose joint distillation, which combines DMD's mode-seeking objective with a Consistency Distillation-based mode-covering constraint. Experiments show that our method improves generation quality, coverage, and diversity; notably, even with a Wan-1.3B DMD teacher, it outperforms baselines refined with Wan-14B, underscoring the importance of distributional alignment in autoregressive video distillation.

视频生成蒸馏分布对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。