arXiv:2510.00948cs.CV2025-10被引 6

提出流式生成视频超分方法,解决长视频处理效率与一致性难题。

InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolution

  • 采用自回归单步扩散机制,结合滚动键值缓存保持时空连贯性。
  • 通过单步去噪与跨块分布匹配,实现58倍速度提升,质量领先。
  • 构建长视频评估基准,引入语义级指标衡量时间一致性,适合视频生成研究者。

真实世界视频常长达数千帧。现有生成式视频超分辨率(VSR)方法在处理长序列时面临两大挑战:(1)全序列多步去噪带来高昂计算开销;(2)时间分解导致伪影与不连续性,影响一致性。为此,本文提出InfVSR,将VSR重构为自回归单步扩散范式,支持基于视频扩散先验的流式推理。首先,将预训练DiT改造为因果结构,通过滚动键值缓存和联合视觉引导维持局部与全局连贯性;其次,通过块级像素监督与跨块分布匹配,将扩散过程高效压缩至单步。为填补长视频评估空白,我们构建新基准并引入语义级评估指标,全面衡量时间一致性。所提方法在长视频VSR上达到当前最优性能,显著提升语义一致性,相较MGLD-VSR等方法最高提速58倍。代码与模型已开源。

原文摘要 · Abstract (English)

Real-world videos often extend over thousands of frames. Existing generative video super-resolution (VSR) approaches, however, face two persistent challenges when processing long sequences: (1) inefficiency due to the heavy cost of multi-step denoising for full-length sequences; and (2) poor consistency is hindered by temporal decomposition that causes artifacts and discontinuities. To break these limits, we propose InfVSR, which reformulates VSR as an autoregressive-one-step-diffusion paradigm, and enables streaming inference with video diffusion priors. First, we adapt the pretrained DiT into a causal structure, maintaining both local and global coherence via rolling KV-cache and joint visual guidance. Second, we distill the diffusion process into a single step efficiently, with patch-wise pixel supervision and cross-chunk distribution matching. To fill the gap in long-form video evaluation, we build a new benchmark tailored for extended sequences and further introduce semantic-level metrics to comprehensively assess temporal consistency. Our method pushes the frontier of long-form VSR, achieves state-of-the-art quality with enhanced semantic consistency, and delivers up to 58x speed-up over existing methods such as MGLD-VSR. Our code and models are available at https://github.com/Kai-Liu001/InfVSR.

视频超分扩散模型流式推理一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。