arXiv:2507.01652cs.CVcs.AI2025-07被引 4

提出线性复杂度图像生成模型,保留2D空间关系提升质量

Autoregressive Image Generation with Linear Complexity: A Spatial-Aware Decay Perspective

  • 用基于真实2D位置的衰减因子设计新型线性注意力机制
  • 在ImageNet上实现顶尖生成质量与线性计算复杂度
  • 适合关注高效高质图像生成的开发者与研究者

自回归(AR)模型在图像生成中表现出色,能有效捕捉视觉数据的局部与全局结构。但主流模型依赖变换器架构,存在序列长度相关的二次计算复杂度和高昂内存开销。尽管线性注意力机制在语言模型中减轻了负担,但初始实验显示其会显著降低图像生成质量,因无法捕捉视觉数据中的关键长程依赖。本文提出线性注意力空间感知衰减(LASAD),通过基于真实2D空间位置而非1D序列位置计算位置相关衰减因子,显式保留图像序列中的2D空间关系。基于此机制,构建LASADGen自回归图像生成器,实现选择性关注相关空间上下文,具备线性复杂度。ImageNet实验表明,LASADGen在生成性能与计算效率上均达到当前最优,弥合了线性注意力的高效性与高质量生成所需空间理解之间的差距。

原文摘要 · Abstract (English)

Autoregressive (AR) models have garnered significant attention in image generation for their ability to effectively capture both local and global structures within visual data. However, prevalent AR models predominantly rely on the transformer architectures, which are beset by quadratic computational complexity concerning input sequence length and substantial memory overhead due to the necessity of maintaining key-value caches. Although linear attention mechanisms have successfully reduced this burden in language models, our initial experiments reveal that they significantly degrade image generation quality because of their inability to capture critical long-range dependencies in visual data. We propose Linear Attention with Spatial-Aware Decay (LASAD), a novel attention mechanism that explicitly preserves genuine 2D spatial relationships within the flattened image sequences by computing position-dependent decay factors based on true 2D spatial location rather than 1D sequence positions. Based on this mechanism, we present LASADGen, an autoregressive image generator that enables selective attention to relevant spatial contexts with linear complexity. Experiments on ImageNet show LASADGen achieves state-of-the-art image generation performance and computational efficiency, bridging the gap between linear attention's efficiency and spatial understanding needed for high-quality generation.

自回归生成线性注意力图像生成空间建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。