arXiv:2510.13669cs.CVcs.AI2025-10

用全局粗略图加速视频生成,少步也能出高清画面

CanvasMAR: Improving Masked Autoregressive Video Prediction With Canvas

  • 引入'画布'作为初始全局结构,指导逐像素生成
  • 仅用5步采样即在Kinetics-600上超越多数自回归模型
  • 适合追求高速高质视频生成的研究者与开发者

掩码自回归模型(MAR)在图像与视频生成中表现强大,但因缺乏全局结构先验,在少量采样步骤下常产生严重失真。为此,我们提出CanvasMAR,通过引入一个模糊的、一步预测的下一帧全局画布作为非均匀掩码,提前提供结构信息,加速并提升生成连贯性。为稳定采样过程,采用基于运动感知的从易到难顺序,先生成静止区域再处理动态部分。同时集成组合式无分类器引导,强化画布与时序条件的协同作用。在BAIR、UCF-101和Kinetics-600数据集上的实验表明,CanvasMAR仅用较少自回归步骤即可生成更高质量视频。在挑战性强的Kinetics-600上,其性能在自回归模型中领先,并媲美先进的扩散模型。

原文摘要 · Abstract (English)

Masked autoregressive models (MAR) have emerged as a powerful paradigm for image and video generation, combining the flexibility of masked modeling with the expressiveness of continuous tokenizers. However, when sampling individual frames, video MAR models often produce highly distorted outputs due to the lack of a structured global prior, especially when using only a few sampling steps. To address this, we propose CanvasMAR, a novel autoregressive video prediction model that predicts high-fidelity frames with few sampling steps by introducing a canvas--a blurred, global one-step prediction of the next frame that serves as a non-uniform mask during masked generation. The canvas supplies global structure early in sampling, enabling faster and more coherent frame synthesis. To further stabilize autoregressive sampling, we propose an easy-to-hard curriculum via a motion-aware sampling order that synthesizes relatively stationary regions before attending to highly dynamic ones. We also integrate compositional classifier-free guidance that jointly strengthens the canvas and temporal conditioning to improve generation fidelity. Experiments on the BAIR, UCF-101, and Kinetics-600 benchmarks demonstrate that CanvasMAR produces higher-quality videos with fewer autoregressive steps. On the challenging Kinetics-600 dataset, CanvasMAR achieves remarkable performance among autoregressive models and rivals advanced diffusion-based methods.

视频生成自回归模型画布引导快速采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。