arXiv:2510.18775cs.CV2025-10AAAI被引 18

突破视频生成分辨率瓶颈,实现1080P至4K的高效端到端生成。

UltraGen: High-Resolution Video Generation with Hierarchical Attention

  • 采用分层双分支注意力架构,分离局部细节与全局语义建模。
  • 首次实现低分辨率模型直接扩展到4K分辨率,生成质量显著提升。
  • 适合需要高分辨率视频生成的研究者与内容创作者使用。

近期视频生成技术已能产出视觉上引人入胜的视频,广泛应用于内容创作、娱乐和虚拟现实。然而,大多数基于扩散变换器的视频生成模型受限于注意力机制随输出宽高呈二次增长的计算复杂度,仅能生成<=720P的低分辨率视频。这一计算瓶颈使得原生高分辨率(1080P/2K/4K)视频生成在训练与推理中均不现实。为此,我们提出UltraGen,一种新型视频生成框架,可实现高效且端到端的原生高分辨率视频合成。UltraGen采用基于全局-局部注意力分解的分层双分支注意力架构,将全注意力解耦为局部注意力分支以保留高保真区域内容,以及全局注意力分支以维持整体语义一致性。我们进一步提出空间压缩的全局建模策略,以高效学习全局依赖,并设计分层跨窗局部注意力机制,在降低计算开销的同时增强不同局部窗口间的信息流动。大量实验表明,UltraGen首次成功将预训练的低分辨率视频模型扩展至1080P乃至4K分辨率,优于现有最先进方法及超分辨率两阶段流水线,在定性和定量评估中均表现卓越。

原文摘要 · Abstract (English)

Recent advances in video generation have made it possible to produce visually compelling videos, with wide-ranging applications in content creation, entertainment, and virtual reality. However, most existing diffusion transformer based video generation models are limited to low-resolution outputs (<=720P) due to the quadratic computational complexity of the attention mechanism with respect to the output width and height. This computational bottleneck makes native high-resolution video generation (1080P/2K/4K) impractical for both training and inference. To address this challenge, we present UltraGen, a novel video generation framework that enables i) efficient and ii) end-to-end native high-resolution video synthesis. Specifically, UltraGen features a hierarchical dual-branch attention architecture based on global-local attention decomposition, which decouples full attention into a local attention branch for high-fidelity regional content and a global attention branch for overall semantic consistency. We further propose a spatially compressed global modeling strategy to efficiently learn global dependencies, and a hierarchical cross-window local attention mechanism to reduce computational costs while enhancing information flow across different local windows. Extensive experiments demonstrate that UltraGen can effectively scale pre-trained low-resolution video models to 1080P and even 4K resolution for the first time, outperforming existing state-of-the-art methods and super-resolution based two-stage pipelines in both qualitative and quantitative evaluations.

视频生成扩散模型高分辨率注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。