arXiv:2510.09212cs.CV2025-10被引 65

让视频生成无限时长且保持连贯,通过自我纠错机制提升稳定性。

Stable Video Infinity: Infinite-Length Video Generation with Error Recycling

  • 用闭环回收自身生成错误作为监督信号,让模型学会主动修正误差。
  • 可生成无限长度视频,且在多个测试集上表现优于现有方法。
  • 适合需要长期一致性视频生成的场景,如动画、虚拟人直播等。

我们提出Stable Video Infinity(SVI),可生成无限长度、时间一致、场景过渡自然且可控叙事流的视频。现有长视频生成方法虽尝试通过手工抗漂移(如修改噪声调度、帧锚定)缓解误差累积,但仍受限于单提示外推,导致场景单调、动作重复。我们发现根本挑战不仅在于误差积累,更在于训练假设(干净数据)与推理时自回归现实(依赖自生成、带错输出)之间的差异。为此,SVI引入误差回收微调(Error-Recycling Fine-Tuning),一种高效训练方式,将扩散Transformer(DiT)自生成的误差转化为监督提示,促使模型主动识别并纠正自身错误。具体实现为:(i) 将DiT历史误差注入干净输入,模拟误差累积轨迹;(ii) 采用一步双向积分高效近似预测,并以残差计算误差;(iii) 动态将误差存入离散时间步的回放记忆中,供后续重采样使用。SVI可在不增加推理成本的前提下,将视频长度从秒级扩展至无限,同时兼容多种条件输入(如音频、骨骼、文本流)。我们在三个基准上评估了SVI,涵盖一致性、创造性和条件设置,全面验证其泛化能力与领先性能。

原文摘要 · Abstract (English)

We propose Stable Video Infinity (SVI) that is able to generate infinite-length videos with high temporal consistency, plausible scene transitions, and controllable streaming storylines. While existing long-video methods attempt to mitigate accumulated errors via handcrafted anti-drifting (e.g., modified noise scheduler, frame anchoring), they remain limited to single-prompt extrapolation, producing homogeneous scenes with repetitive motions. We identify that the fundamental challenge extends beyond error accumulation to a critical discrepancy between the training assumption (seeing clean data) and the test-time autoregressive reality (conditioning on self-generated, error-prone outputs). To bridge this hypothesis gap, SVI incorporates Error-Recycling Fine-Tuning, a new type of efficient training that recycles the Diffusion Transformer (DiT)'s self-generated errors into supervisory prompts, thereby encouraging DiT to actively identify and correct its own errors. This is achieved by injecting, collecting, and banking errors through closed-loop recycling, autoregressively learning from error-injected feedback. Specifically, we (i) inject historical errors made by DiT to intervene on clean inputs, simulating error-accumulated trajectories in flow matching; (ii) efficiently approximate predictions with one-step bidirectional integration and calculate errors with residuals; (iii) dynamically bank errors into replay memory across discretized timesteps, which are resampled for new input. SVI is able to scale videos from seconds to infinite durations with no additional inference cost, while remaining compatible with diverse conditions (e.g., audio, skeleton, and text streams). We evaluate SVI on three benchmarks, including consistent, creative, and conditional settings, thoroughly verifying its versatility and state-of-the-art role.

视频生成扩散模型自回归误差修正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。