arXiv:2607.15849cs.CVcs.AI2026-07

通过测试时噪声引导优化,解决自回归视频生成中的轨迹终止问题。

Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generation

  • 利用扩散模型自我评判输出,预测下一步噪声并保持各向同性。
  • 在VBench上提升3.1%、15秒视频的FVD降低28.3%。
  • 适合追求长视频生成稳定性的研究者与开发者。

自回归视频扩散模型通过去除对后续帧的依赖,实现了任意长度视频的生成,显著提升了计算效率。然而,其存在随时间累积误差的问题,导致去噪序列逐渐偏离训练时的分布。尽管近期方法尝试通过将每帧锚定在真实数据流形上来缓解,但即使单帧接近真实,模型仍可能因缺乏足够知识而陷入无法继续的终点轨迹。为此,本文提出测试时噪声引导优化(TANGO),基于良好建模的未来轨迹其预测噪声分布应与前向加噪过程一致的假设,让扩散模型作为自身输出的评判者:通过预测下一步并要求噪声为各向同性高斯分布,以偏差来搜索不导向终点的替代轨迹。该方法在VBench上实现3.1%的绝对提升,并在15秒视频上平均降低28.3%的弗雷谢视频距离。

原文摘要 · Abstract (English)

Autoregressive video diffusion models have enabled the generation of arbitrarily long videos by removing conditioning on future frames, thus greatly improving computational efficiency. Yet, they suffer from error accumulation over time, as the denoised sequence gradually drifts away from the conditioning distribution seen during training. Recent advances attempt to reduce this error by anchoring each generated frame to the learned manifold of real ones. However, even when all generated individual frames lie close to the real manifold, there are trajectories which the model lacks sufficient knowledge to continue without exiting it, thus reaching a terminal point. To prevent the model from being trapped in terminal points, we start from the hypothesis that for well-modeled future trajectories the distribution of the predicted noise should match the one of the forward noising process. To enforce such a prior at test time, we introduce Terminal points Avoidance through Noise Guided Optimization (TANGO), which uses the diffusion model as a critic of its own outputs, by predicting one step forward and requiring an isotropic Gaussian noise prediction. We use the deviation from this expected noise distribution to search for an alternative trajectory that does not lead to a terminal point. Our approach achieves a $3.1\%$ absolute improvement on VBench over state-of-the-art, while reducing Fréchet Video Distance by $28.3\%$ on average across $15$s videos. Our code is available on https://mever-team.github.io/tango.

视频生成扩散模型测试时优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。