arXiv:2510.16325cs.CV2025-10被引 1

突破图像生成分辨率瓶颈,实现8K级高效生成。

UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention

论文配图:UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention
图 1 · 摘自论文原文
  • 分块局部注意力+低分辨率全局引导,降低计算复杂度
  • 支持超8K分辨率生成,速度提升10倍以上,显存更低
  • 适合需要极致细节与大图一致性的设计、影视应用

超高分辨率文本到图像生成在需要精细纹理和全局结构一致性的应用中日益重要,但当前主流扩散模型如FLUX和SD3受限于注意力机制的二次复杂度及高质量高分辨率训练数据稀缺,仅能生成低于2MP(<1K×2K)的图像。本文提出UltraImageGen,引入分层局部注意力与低分辨率全局引导,实现高效、可扩展且语义连贯的超高清图像合成。具体地,将高分辨率潜在表示划分为硬件对齐的固定大小局部窗口,使注意力复杂度从二次降至近线性;同时使用带缩放位置嵌入的低分辨率潜在表示注入全局语义作为锚点。轻量级LoRA适配器在去噪过程中连接全局与局部路径,确保结构与细节的一致性。为最大化推理效率并实现可扩展的超高清生成,我们采用窗口优先的标记序列重排,使注意力计算中的密集局部块始终等于二维中的固定大小窗口,不受分辨率影响。联合实验表明,本方法可稳定扩展预训练模型至超过8K分辨率,实现10倍以上加速与显著更低的内存占用。大量实验证明,该方法在保持计算效率的同时达到更优质量,为推进超高分辨率图像生成提供了实用范式。

原文摘要 · Abstract (English)

Ultra-high-resolution text-to-image generation is increasingly vital for applications requiring fine-grained textures and global structural fidelity, yet state-of-the-art text-to-image diffusion models such as FLUX and SD3 remain confined to sub 2MP (< $1K\times2K$) resolutions due to the quadratic complexity of attention mechanisms and the scarcity of high-quality high-resolution training data. We present UltraImageGen, a novel framework that introduces hierarchical local attention with low-resolution global guidance, enabling efficient, scalable, and semantically coherent image synthesis at ultra-high resolutions. Specifically, high-resolution latents are divided into hardware aligned fixed-size local windows to reduce attention complexity from quadratic to near-linear, while a low-resolution latent equipped with scaled positional embeddings injects global semantics as an anchor. A lightweight LoRA adaptation bridges global and local pathways during denoising, ensuring consistency across structure and detail. To maximize inference efficiency and achieve scalable ultra-high-resolution generation, we repermute token sequence in window-first order, so that the GPU-friendly dense local blocks in attention calculation equals to the fixed-size local window in 2D regardless of resolution. Together ourwork reliably scales the pretrained model to resolutions higher than $8K$ with more than $10\times$ speed up and significantly lower memory usage. Extensive experiments demonstrate that ourwork achieves superior quality while maintaining computational efficiency, establishing a practical paradigm for advancing ultra-high-resolution image generation.

图像生成扩散模型超分辨率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。