用新方法让视频生成模型变小变快,还能保持甚至提升质量。
V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Models
- 结合强化学习与微调,让小模型专注恢复关键特性而非照搬大模型。
- 在两个主流模型上实现超67%参数压缩,性能不降反升。
- 适合需要轻量化部署的视频生成应用开发者。
随着文本到视频(T2V)模型在资源受限环境中的部署需求增长,降低其高计算成本变得至关重要。现有知识蒸馏方法多依赖监督微调(SFT),常导致模式崩溃:参数减少的模型因容量不足,无法直接匹配教师模型输出,最终造成质量下降。为此,我们提出ReDPO方法,融合直接偏好优化(DPO)与SFT,使学生模型聚焦于恢复目标属性,而非被动模仿教师输出;同时提出V.I.P.框架,用于筛选和构建高质量数据对,并采用逐步在线训练策略进行校准。我们在VideoCrafter2和AnimateDiff两个领先模型上验证该方法,分别实现36.2%和67.5%的参数压缩,且性能保持或超越原全量模型。实验进一步证明ReDPO与V.I.P.框架在实现高效高质量视频生成方面的有效性。代码与演示视频见https://jiiiisoo.github.io/VIP.github.io/。
原文摘要 · Abstract (English)
With growing interest in deploying text-to-video (T2V) models in resource-constrained environments, reducing their high computational cost has become crucial, leading to extensive research on pruning and knowledge distillation methods while maintaining performance. However, existing distillation methods primarily rely on supervised fine-tuning (SFT), which often leads to mode collapse as pruned models with reduced capacity fail to directly match the teacher's outputs, ultimately resulting in degraded quality. To address this challenge, we propose an effective distillation method, ReDPO, that integrates DPO and SFT. Our approach leverages DPO to guide the student model to focus on recovering only the targeted properties, rather than passively imitating the teacher, while also utilizing SFT to enhance overall performance. We additionally propose V.I.P., a novel framework for filtering and curating high-quality pair datasets, along with a step-by-step online approach for calibrated training. We validate our method on two leading T2V models, VideoCrafter2 and AnimateDiff, achieving parameter reduction of 36.2% and 67.5% each, while maintaining or even surpassing the performance of full models. Further experiments demonstrate the effectiveness of both ReDPO and V.I.P. framework in enabling efficient and high-quality video generation. Our code and videos are available at https://jiiiisoo.github.io/VIP.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。