通过可靠性与困惑度感知机制,提升流式视频生成的蒸馏质量。
Stream-R1: Reliability-Perplexity Aware Reward Distillation for Streaming Video Generation

- 基于预训练奖励模型,动态调整每轮生成和每个像素的优化权重。
- 在标准基准上实现视觉、运动与文本对齐三方面一致提升。
- 无需修改架构或增加推理开销,适合实际部署场景。
基于蒸馏的加速已成为使自回归流式视频扩散模型实用化的基础,其中分布匹配蒸馏(DMD)是主流方法。然而,现有方法对教师输出的监督不加区分,将每一轮生成、每一帧、每个像素视为同等可靠。本文指出,这限制了蒸馏质量,因为忽略了两个互补的变异性维度:不同学生生成轮次间的可靠性差异,以及空间区域与时间帧内困惑度的不均衡贡献。为此,我们提出Stream-R1,一种可靠性-困惑度感知的奖励蒸馏框架,通过单一共享的奖励引导机制,在生成轮次和时空元素层面自适应重加权蒸馏目标。在跨轮次可靠性层面,以预训练视频奖励得分的指数值缩放每轮损失,使可靠监督主导优化;在内部困惑度层面,回传同一奖励模型提取像素级梯度显著性,用于生成空间与时间权重,聚焦于改进预期收益最大的区域与帧。自适应平衡机制防止任一质量维度过度主导。Stream-R1在标准流式视频生成基准上,相较基线在视觉质量、运动质量和文本对齐三个维度均取得一致提升,且无需架构修改或额外推理成本。
原文摘要 · Abstract (English)
Distillation-based acceleration has become foundational for making autoregressive streaming video diffusion models practical, with distribution matching distillation (DMD) as the de facto choice. Existing methods, however, train the student to match the teacher's output indiscriminately, treating every rollout, frame, and pixel as equally reliable supervision. We argue that this caps distilled quality, since it overlooks two complementary axes of variance in DMD supervision: Inter-Reliability across student rollouts whose supervision varies in reliability, and Intra-Perplexity across spatial regions and temporal frames that contribute unequally to where quality can still be improved. The objective thus conflates two questions under a uniform weight: whether to learn from each rollout, and where to concentrate optimization within it. To address this, we propose Stream-R1, a Reliability-Perplexity Aware Reward Distillation framework that adaptively reweights the distillation objective at both rollout and spatiotemporal-element levels through a single shared reward-guided mechanism. At the Inter-Reliability level, Stream-R1 rescales each rollout's loss by an exponential of a pretrained video reward score, so that rollouts with reliable supervision dominate optimization. At the Intra-Perplexity level, it back-propagates the same reward model to extract per-pixel gradient saliency, which is factored into spatial and temporal weights that concentrate optimization pressure on regions and frames where refinement yields the largest expected gain. An adaptive balancing mechanism prevents any single quality axis from dominating across visual quality, motion quality, and text alignment. Stream-R1 attains consistent improvements on all three dimensions over distillation baselines on standard streaming video generation benchmarks, without architectural modification or additional inference cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。