arXiv:2607.08766cs.CV2026-07被引 3

通过自蒸馏提升少步自回归视频生成的长时序质量

OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators

论文配图:OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators
图 1 · 摘自论文原文
  • 用真实长视频作为时间上下文,对生成过程进行密集修正
  • 在不改变推理路径的前提下,显著改善运动连贯性和视觉质量
  • 适合关注视频生成长期一致性与流畅性的研究者

我们提出OPSD-V,一种用于后训练少步自回归视频扩散模型的在线自蒸馏范式。现有少步自回归视频生成器虽能实现低延迟长视频生成,但在长序列推理中仍存在误差累积和运动动态弱化问题。OPSD-V在不改变原始推理路径的前提下,有效缓解长时序退化。核心思想是在训练中引入真实长视频作为时间上下文,提供密集轨迹级监督。学生模型沿推理时的相同滚动路径生成,每一块均基于自身先前生成的键值缓存;教师模型在同一去噪状态评估,但使用更清洁的、可被真实视频上下文替换的时序缓存。这在保持在线策略和缓存机制不变的情况下,提供了去噪级别的密集校正目标。我们将OPSD-V应用于代表性少步自回归视频模型(如Self-Forcing和LongLive)。实验显示,在视觉质量、运动动态和VBenchLong评分上均有持续提升。10名参与者对20组视频对的用户研究显示,OPSD-V在总体偏好判断中胜出66.0%(剔除平局后为82.5%)。

原文摘要 · Abstract (English)

We propose OPSD-V, an on-policy self-distillation paradigm for post-training few-step autoregressive (AR) video diffusion models. Existing few-step AR video generators can produce long videos with low latency, but still suffer from error accumulation and weakened motion dynamics during long autoregressive rollout. OPSD-V reduces long-horizon degradation while preserving the original few-step inference path. The key idea is to introduce real long-video data as temporal context during training and use it to provide dense trajectory-level supervision. Specifically, the student follows the exact inference-time rollout, generating each chunk conditioned on its own previously generated KV cache. In parallel, the teacher is evaluated at the same student-visited denoising states, but uses a cleaner AR-consistent temporal cache in which older history can be replaced by real-video context. This provides dense denoising-level corrective targets under on-policy AR cache dynamics, without changing the sampler, number of denoising steps, or inference-time cache mechanism. We apply OPSD-V to representative few-step AR video models, including Self-Forcing and LongLive. Experiments show consistent improvements in visual quality, motion dynamics, and VBenchLong scores. A user study with 10 participants comparing 20 video pairs shows that OPSD-V is preferred over the base models in 66.0% of overall-preference judgments (82.5% excluding ties).

视频生成自回归自蒸馏扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。