让视频生成更快更轻,4步采样+30%参数量仍保高质量。
FastLightGen: Fast and Light Video Generation with Fewer Steps and Parameters
- 构建协同蒸馏框架,同时压缩模型大小和采样步数。
- 4步采样、30%参数剪枝下仍达最优视觉质量。
- 适合需要高效部署的实时视频生成场景。
近期以 Hunyuan、WanX、Veo3 和 Kling 为代表的强大视频生成模型开启了新纪元,但其实际部署受限于巨大的计算开销,源于庞大的参数量和推理时所需的迭代多步采样。以往加速研究主要沿两个方向:减少采样步数(如 LCM、DMD、MagicDistillation)或压缩模型规模(如 ICMD)。同时压缩两者以实现快速轻量化的潜力尚未被探索。本文提出 FastLightGen,将大型昂贵模型转化为快速轻量版本。核心思想是在协同蒸馏框架中构建最优教师模型,以最大化学生模型性能,实现模型尺寸与推理步数的联合蒸馏。在 HunyuanVideo-ATI2V 与 WanX-TI2V 上的大量实验表明,在 4 步采样和 30% 参数剪枝条件下,生成器在有限推理预算下达到最佳视觉质量。此外,FastLightGen 持续优于所有对比方法,确立了高效视频生成的新基准。
原文摘要 · Abstract (English)
The recent advent of powerful video generation models, such as Hunyuan, WanX, Veo3, and Kling, has inaugurated a new era in the field. However, the practical deployment of these models is severely impeded by their substantial computational overhead, which stems from enormous parameter counts and the iterative, multi-step sampling process required during inference. Prior research on accelerating generative models has predominantly followed two distinct trajectories: reducing the number of sampling steps (e.g., LCM, DMD, and MagicDistillation) or compressing the model size for more efficient inference (e.g., ICMD). The potential of simultaneously compressing both to create a fast and lightweight model remains an unexplored avenue. In this paper, we propose FastLightGen, an algorithm that transforms large, computationally expensive models into fast, lightweight counterparts. The core idea is to construct an optimal teacher model, one engineered to maximize student performance, within a synergistic framework for distilling both model size and inference steps. Our extensive experiments on HunyuanVideo-ATI2V and WanX-TI2V reveal that a generator using 4-step sampling and 30\% parameter pruning achieves optimal visual quality under a constrained inference budget. Furthermore, FastLightGen consistently outperforms all competing methods, establishing a new state-of-the-art in efficient video generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。