arXiv:2510.02283cs.CVcs.AI2025-10被引 170

无需长视频训练,实现分钟级高质量视频生成

Self-Forcing++: Towards Minute-Scale High-Quality Video Generation

  • 用自生成片段引导学生模型,避免误差累积
  • 生成时长达4分15秒,比基线长50倍以上
  • 保持时序一致性,适合长视频生成任务

扩散模型在图像和视频生成中取得突破性进展,但其依赖Transformer架构导致计算成本高昂,尤其在生成长视频时。现有方法多采用自回归形式,通过短时双向教师模型蒸馏知识,但由于教师无法生成长视频,学生模型超出训练范围后常出现质量显著下降,源于连续潜在空间中的误差累积。本文提出Self-Forcing++,通过从自生成的长视频中采样片段,利用教师模型的知识指导学生模型,无需长视频监督或重新训练。该方法在不重算重叠帧的前提下,将视频长度扩展至教师能力的20倍,生成最长可达4分15秒(约99.9%基础模型位置嵌入支持的最大跨度),远超基线模型50倍以上。在标准基准及新提出的改进基准上,所生成视频在保真度与一致性方面均显著优于基线方法。

原文摘要 · Abstract (English)

Diffusion models have revolutionized image and video generation, achieving unprecedented visual quality. However, their reliance on transformer architectures incurs prohibitively high computational costs, particularly when extending generation to long videos. Recent work has explored autoregressive formulations for long video generation, typically by distilling from short-horizon bidirectional teachers. Nevertheless, given that teacher models cannot synthesize long videos, the extrapolation of student models beyond their training horizon often leads to pronounced quality degradation, arising from the compounding of errors within the continuous latent space. In this paper, we propose a simple yet effective approach to mitigate quality degradation in long-horizon video generation without requiring supervision from long-video teachers or retraining on long video datasets. Our approach centers on exploiting the rich knowledge of teacher models to provide guidance for the student model through sampled segments drawn from self-generated long videos. Our method maintains temporal consistency while scaling video length by up to 20x beyond teacher's capability, avoiding common issues such as over-exposure and error-accumulation without recomputing overlapping frames like previous methods. When scaling up the computation, our method shows the capability of generating videos up to 4 minutes and 15 seconds, equivalent to 99.9% of the maximum span supported by our base model's position embedding and more than 50x longer than that of our baseline model. Experiments on standard benchmarks and our proposed improved benchmark demonstrate that our approach substantially outperforms baseline methods in both fidelity and consistency. Our long-horizon videos demo can be found at https://self-forcing-plus-plus.github.io/

视频生成扩散模型长视频自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。