用在线对抗流蒸馏,让自回归视频生成模型更流畅准确。
On-Policy Adversarial Flow Distillation for Autoregressive Video Generation

- 通过师生同提示滚动,构建对比判别器评估差异
- 在噪声状态上实现密集速度场监督,提升运动生成质量
- 无需教师得分或轨迹,适合私有模型蒸馏
自回归视频生成器适用于流式、长时序和交互应用,但将强黑箱教师模型蒸馏为因果学生模型仍具挑战。学生需在自身生成分布下学习,而实际教师仅提供提示条件下的完整视频,且在架构、容量、时间设计和采样调度上可能不同。这使得监督微调为非策略,基于分数的蒸馏不适用,直接对抗模仿又因去噪时间信用分配过稀疏而失效。本文提出对抗流蒸馏(AFD),一种用于异构黑箱视频蒸馏的在线策略框架。AFD 在相同提示下查询教师并滚动当前学生,训练提示配对的布拉德利-特里判别器以估计干净样本的师生差异,并将所得在线优势转化为对学生自身噪声状态的前向过程流匹配更新。因此,AFD 提供密集的速度场监督,且无需教师得分、潜在变量、去噪轨迹、步骤对齐或反向链强化学习。跨两类因果自回归学生模型的实验表明,AFD 持续提升运动与物理敏感性生成效果,同时保持整体视频质量;消融实验验证了自适应在线反馈和前向过程信用分配的重要性。该方法仅需教师干净视频与学生滚动结果,为将专有或异构视频生成器蒸馏为高效自回归学生提供了实用路径。
原文摘要 · Abstract (English)
Autoregressive video generators are attractive for streaming, long-horizon, and interactive applications, but distilling strong black-box teachers into causal students remains difficult. The student must learn under its own rollout distribution, whereas practical teachers may expose only prompt-conditioned completed videos and may differ in architecture, capacity, temporal design, and sampling schedule. This interface makes supervised fine-tuning off-policy, score-based distillation inapplicable, and direct adversarial imitation too sparse for denoising-time credit assignment. We propose Adversarial Flow Distillation (AFD), an on-policy framework for heterogeneous black-box video distillation. AFD queries the teacher and rolls out the current student on the same prompts, trains a prompt-paired Bradley-Terry discriminator to estimate clean-sample teacher-student discrepancy, and converts the resulting on-policy advantage into forward-process flow-matching updates on the student's own noised states. Thus, AFD provides dense velocity-field supervision while requiring no teacher scores, latents, denoising trajectories, step alignment, or reverse-chain reinforcement learning. Experiments across two causal AR student families show that AFD consistently improves motion- and physics-sensitive generation while preserving general video quality, and ablations validate the importance of adaptive on-policy feedback and forward-process credit assignment. The method requires only clean teacher videos and student rollouts, providing a practical route for distilling proprietary or heterogeneous video generators into efficient autoregressive students.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。