arXiv:2603.08703cs.CV2026-03被引 11

提出分层去噪框架HiAR,实现长视频高效自回归生成。

HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoising

  • 采用同噪声水平条件建模,避免误差累积
  • 4步设置下推理速度提升1.8倍,20秒视频得分最优
  • 适合需要高时序连续性的长视频生成任务

自回归扩散模型可生成理论上无限长度的视频,但存在因误差积累导致质量渐进下降的问题。现有方法通常依赖高度去噪的上下文以保证时序连续性,却会放大预测误差。本文提出,高清洁度上下文并非必要。受双向扩散模型启发,我们主张在与当前块相同噪声水平下进行上下文条件建模,既能保持一致性,又能有效抑制误差传播。基于此,提出分层去噪框架HiAR:不按顺序完成每一块,而是在每个去噪步骤中对所有块进行因果生成,使每块始终基于同噪声水平的上下文。该结构天然支持流水线并行推理,在4步设置下获得1.8倍实际运行速度提升。进一步发现,在此范式下,自回放蒸馏会放大模式搜索反KL目标的低运动捷径。为此,引入双向注意力模式下的前向KL正则项,在不干扰蒸馏损失的前提下保留运动多样性。在VBench(20秒生成)上,HiAR取得最佳综合评分和最低时序漂移。

原文摘要 · Abstract (English)

Autoregressive (AR) diffusion offers a promising framework for generating videos of theoretically infinite length. However, a major challenge is maintaining temporal continuity while preventing the progressive quality degradation caused by error accumulation. To ensure continuity, existing methods typically condition on highly denoised contexts; yet, this practice propagates prediction errors with high certainty, thereby exacerbating degradation. In this paper, we argue that a highly clean context is unnecessary. Drawing inspiration from bidirectional diffusion models, which denoise frames at a shared noise level while maintaining coherence, we propose that conditioning on context at the same noise level as the current block provides sufficient signal for temporal consistency while effectively mitigating error propagation. Building on this insight, we propose HiAR, a hierarchical denoising framework that reverses the conventional generation order: instead of completing each block sequentially, it performs causal generation across all blocks at every denoising step, so that each block is always conditioned on context at the same noise level. This hierarchy naturally admits pipelined parallel inference, yielding a 1.8 wall-clock speedup in our 4-step setting. We further observe that self-rollout distillation under this paradigm amplifies a low-motion shortcut inherent to the mode-seeking reverse-KL objective. To counteract this, we introduce a forward-KL regulariser in bidirectional-attention mode, which preserves motion diversity for causal inference without interfering with the distillation loss. On VBench (20s generation), HiAR achieves the best overall score and the lowest temporal drift among all compared methods.

视频生成扩散模型自回归长视频

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。