arXiv:2512.24639cs.CV2025-12

用环形顺序并行生成图像,速度更快且不丢细节。

From Sequential to Spatial: Reordering Autoregression for Efficient Visual Generation

  • 以中心点为起点,按距离分环并行生成像素
  • 相比传统逐个生成,推理速度提升显著
  • 适合需要快速生成高质量图像的场景

受自回归语言模型成功的启发,该范式已被广泛应用于视觉生成。然而,传统自回归模型逐个令牌解码的机制导致推理效率低下。本文提出RadAR,一种高效且可并行化的框架,旨在加速自回归视觉生成的同时保持其表征能力。我们的方法受到视觉令牌具有强局部依赖性和空间相关性的启发——这一特性在标准栅格扫描解码顺序中未被充分利用。具体而言,我们以径向拓扑组织生成过程:选择一个初始令牌作为中心点,其余所有令牌根据其与中心的距离被系统地划分为多个同心环,生成按环从内到外进行,同一环内的所有令牌可并行预测。该设计不仅保留了视觉场景的结构局部性与空间连贯性,还大幅提升了并行度。此外,为应对同时生成多个令牌时因上下文有限而导致的预测不一致风险,我们引入嵌套注意力机制,在前向传播中动态修正不合理输出,从而缓解误差累积并防止模型崩溃。通过结合径向并行预测与动态输出校正,RadAR显著提升了生成效率。

原文摘要 · Abstract (English)

Inspired by the remarkable success of autoregressive models in language modeling, this paradigm has been widely adopted in visual generation. However, the sequential token-by-token decoding mechanism inherent in traditional autoregressive models leads to low inference efficiency.In this paper, we propose RadAR, an efficient and parallelizable framework designed to accelerate autoregressive visual generation while preserving its representational capacity. Our approach is motivated by the observation that visual tokens exhibit strong local dependencies and spatial correlations with their neighbors--a property not fully exploited in standard raster-scan decoding orders. Specifically, we organize the generation process around a radial topology: an initial token is selected as the starting point, and all other tokens are systematically grouped into multiple concentric rings according to their spatial distances from this center. Generation then proceeds in a ring-wise manner, from inner to outer regions, enabling the parallel prediction of all tokens within the same ring. This design not only preserves the structural locality and spatial coherence of visual scenes but also substantially increases parallelization. Furthermore, to address the risk of inconsistent predictions arising from simultaneous token generation with limited context, we introduce a nested attention mechanism. This mechanism dynamically refines implausible outputs during the forward pass, thereby mitigating error accumulation and preventing model collapse. By integrating radial parallel prediction with dynamic output correction, RadAR significantly improves generation efficiency.

图像生成自回归并行化扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。