arXiv:2608.13391cs.CV2026-08

解决视频生成中教师指导与学生因果信息不匹配的问题。

Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation

论文配图:Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation
图 1 · 摘自论文原文
  • 用因果教师替代双向教师,确保每帧生成仅依赖历史信息。
  • 在短视频和长视频任务上均达到当前最优性能,且控制更精准。
  • 适用于分帧、分块及相机条件生成,适合需要实时控制的场景。

交互式自回归视频生成要求低延迟推演和精确在线控制。少步蒸馏通过减少去噪步骤加速生成,但在线控制带来因果约束:每一帧和每一模块只能依赖生成时已知的历史和控制信号。现有视频分布匹配蒸馏(DMD)流程常使用双向教师对完整片段进行评分,导致目标帧的得分可能依赖未来帧或控制信号,与学生实际可获取的信息不符,造成监督失配。我们提出上下文匹配蒸馏(CMD),一种因果导向的DMD框架,使教师监督始终与学生生成时的可用信息一致。CMD将双向全片段评分替换为因果教师,该教师在生成每个目标时无法访问未来帧或控制信号。同一因果教师用于初始化少步学生,确保训练、蒸馏与推理阶段的因果一致性。此外,前缀评分(Prefix Scoring)根据实际生成的前缀序列评估目标,进一步匹配学生的真实生成上下文;前缀扰动(Prefix Corruption)则通过干扰训练初期不可靠的前缀来稳定训练过程。凭借简洁的因果设定,CMD自然扩展至分帧/分块生成、长视频蒸馏及相机条件蒸馏。实验表明,在短视频与长视频基准测试中,其综合性能优于当前主流自回归方法,且对随时间变化的相机控制响应显著提升。

原文摘要 · Abstract (English)

Interactive autoregressive video generation demands both low-latency rollouts and precise online control. Few-step distillation accelerates generation by reducing denoising steps, while online control imposes a causal constraint: frames and blocks should depend on history and controls available during generation. Existing video distribution matching distillation (DMD) pipelines, however, often supervise causal few-step students using bidirectional teachers that score complete clips. The score for a target can therefore depend on future frames and controls that were unavailable when the student generated it, misaligning teacher supervision with the student's causal information set. We introduce Context-Matched Distillation (CMD), a causal DMD framework that aligns teacher supervision with the information available when each target is generated. CMD replaces bidirectional full-clip scoring with a causal teacher that evaluates each target without access to future frames or controls. The same causal teacher initializes the few-step student, establishing a consistent causal formulation across teacher training, student distillation, and inference. Beyond aligning the temporal information boundary, Prefix Scoring matches supervision to the student's realized rollout context by evaluating each target under the cached student-generated prefix that produced it. Prefix Corruption further stabilizes training by perturbing unreliable prefixes produced early in training while preserving this target-context alignment. With a simple causal formulation, CMD naturally extends to frame-wise and chunk-wise generation, long video distillation, and camera-conditioned distillation. Experiments demonstrate state-of-the-art aggregate performance among autoregressive methods on both short- and long-video benchmarks, together with substantially improved adherence to time-varying camera controls.

视频生成因果蒸馏自回归模型实时控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。