arXiv:2503.18942cs.CVcs.AI2025-03ICCV被引 46

通过测试时计算提升视频生成质量,无需增加训练成本

Video-T1: Test-Time Scaling for Video Generation

  • 将测试时扩展视为搜索过程,从噪声空间寻找更优视频轨迹
  • 在文本条件视频生成任务中,测试时计算越多,视频质量越高
  • 提出树状帧方法,自适应生成并剪枝视频分支,效率更高

随着训练数据、模型规模和计算成本的增加,视频生成在数字创作中取得了显著进展,使用户能在多个领域表达创意。近期大语言模型(LLMs)的研究将扩展能力延伸至测试时,通过增加推理阶段的计算量显著提升性能。本文不依赖昂贵的训练成本来扩展视频基础模型,而是探索测试时扩展(Test-Time Scaling, TTS)在视频生成中的潜力,回答关键问题:若允许视频生成模型使用大量推理阶段计算,面对具有挑战性的文本提示时,能多大程度提升生成质量。我们重新将视频生成的测试时扩展建模为搜索问题,旨在从高斯噪声空间采样更优轨迹以逼近目标视频分布。具体地,构建测试时验证器反馈机制与启发式算法引导搜索过程。给定文本提示后,首先采用直观的线性搜索策略,在推理阶段逐步增加噪声候选样本。由于全步去噪所有帧同时进行计算开销过大,进一步设计了更高效的视频生成测试时扩展方法——树状帧(Tree-of-Frames, ToF),该方法以自回归方式动态扩展和剪枝视频分支。在多个文本条件视频生成基准上的实验表明,增加测试时计算可持续带来显著的视频质量提升。

原文摘要 · Abstract (English)

With the scale capability of increasing training data, model size, and computational cost, video generation has achieved impressive results in digital creation, enabling users to express creativity across various domains. Recently, researchers in Large Language Models (LLMs) have expanded the scaling to test-time, which can significantly improve LLM performance by using more inference-time computation. Instead of scaling up video foundation models through expensive training costs, we explore the power of Test-Time Scaling (TTS) in video generation, aiming to answer the question: if a video generation model is allowed to use non-trivial amount of inference-time compute, how much can it improve generation quality given a challenging text prompt. In this work, we reinterpret the test-time scaling of video generation as a searching problem to sample better trajectories from Gaussian noise space to the target video distribution. Specifically, we build the search space with test-time verifiers to provide feedback and heuristic algorithms to guide searching process. Given a text prompt, we first explore an intuitive linear search strategy by increasing noise candidates at inference time. As full-step denoising all frames simultaneously requires heavy test-time computation costs, we further design a more efficient TTS method for video generation called Tree-of-Frames (ToF) that adaptively expands and prunes video branches in an autoregressive manner. Extensive experiments on text-conditioned video generation benchmarks demonstrate that increasing test-time compute consistently leads to significant improvements in the quality of videos. Project page: https://liuff19.github.io/Video-T1

视频生成测试时扩展自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。