通过解耦全局与局部建模,实现4K级超长视频高效生成。
AtlasVid: Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modeling

- 分两阶段生成:先低分辨率全局语义代理,再高分辨率细节修复。
- 训练仅需720P+轻量LoRA,却可直接生成4K以上超长视频。
- 比原生4K模型快60.9倍,成本更低且画质更优。
基于扩散的视频生成模型虽已实现高视觉保真度和提示可控性,但扩展至超高清(UHR)长视频仍成本高昂。尤其在单镜头连续生成中,需保持全局时间连贯性与精细空间细节,而无需依赖片段拼接或自回归剪辑。本文从解耦建模视角出发,提出AtlasVid框架。该模型首先通过时序缩放的RoPE生成低分辨率、低帧率的全局语义代理,从而扩展时间范围而不增加训练标记数;随后,在该代理引导下,高分辨率细节分支采用分层保留局部性的注意力进行联合去噪。重排的时空窗口维持几何局部性,非对称的全局-局部注意力注入对齐语义指导并保留预训练能力。此设计实现分辨率无关训练:模型仅在720P上训练,结合轻量LoRA适配,即可直接推广至4K及以上分辨率,生成超过10秒的长视频。实验表明,AtlasVid显著提升超高清长视频生成效率,实现60.9倍速度提升,训练成本更低,性能甚至优于原生4K生成器。
原文摘要 · Abstract (English)
Recent diffusion-based video generators have achieved remarkable visual fidelity and prompt controllability, yet scaling them to ultra-high-resolution (UHR) long videos remains prohibitively expensive. The difficulty is especially pronounced for long single-shot generation where a continuous scene must preserve global temporal coherence, and fine-grained spatial details without relying on clip transitions or autoregressive shot stitching. In this work, we revisit this challenge from the perspective of decoupled modeling. We argue that existing video diffusion models already encode strong local visual priors, while the main bottleneck lies in efficiently extending global spatiotemporal modeling as resolution and duration increase. Based on this insight, we propose AtlaVid, a decoupled global-local framework for efficient UHR long video generation. AtlaVid first generates a low-resolution and low-FPS global semantic proxy via temporally scaled RoPE, thereby extending the temporal horizon without increasing the training token count. Guided by this proxy, a high-resolution detail branch performs joint denoising with hierarchical locality-preserving attention. Reordered spatiotemporal windows preserve geometric locality and asymmetric global-local attention injects aligned semantic guidance and preserves the model's pretrained ability. This design enables resolution-agnostic training: the model is trained only at 720P with lightweight LoRA adaptation, yet generalizes directly to 4K and beyond for longer (>10s) video synthesis. Experiments show that AtlaVid substantially improves the efficiency of ultra-high-resolution long video generation, achieving high-quality UHR long video generation with 60.9x speed up and significantly less training cost and even better performance than native 4K video generators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。