arXiv:2605.09430cs.CV2026-05被引 2

让自回归图像生成模型提速20倍以上,不重训练也能并行生成。

FlashAR: Efficient Post-Training Acceleration for Autoregressive Image Generation

论文配图:FlashAR: Efficient Post-Training Acceleration for Autoregressive Image Generation
图 1 · 摘自论文原文
  • 用双方向预测机制,在不改原模型结构前提下实现并行生成。
  • 仅用0.05%数据微调,512×512图像生成速度提升22.9倍。
  • 适合想快速加速已有自回归图像模型的研究者和开发者。

大规模自回归模型在图像生成中表现优异,但其逐像素扫描解码依赖严格顺序预测,推理成本高昂。现有加速方法要么需从头预训练新范式,要么牺牲生成质量或改变预测目标。本文提出FlashAR,一种轻量级后训练适配框架,将预训练的自回归模型高效转化为高度并行生成器。核心思想是尽量保留原始训练目标以维持先验知识:保留原模型的水平头进行行方向预测,引入轻量级垂直头实现列方向预测。为降低适配成本,垂直头从中间层分支而非最终层,避免水平头偏差;同时设计可学习融合门,动态平衡两个方向的预测权重。采用两阶段适配流程:先用预训练模型初始化垂直头,再与主干联合微调。在LlamaGen和Emu3.5上实验表明,仅用0.05%原始训练数据,即可实现512×512图像生成最高22.9倍加速。

原文摘要 · Abstract (English)

Large-scale autoregressive models have demonstrated remarkable capabilities in image generation. However, their sequential raster-scan decoding relies on strictly next-token prediction, making inference prohibitively expensive. Existing acceleration methods typically either introduce entirely new generation paradigms that necessitate costly pre-training from scratch, or enable parallel generation at the expense of a training-inference gap or altered prediction objectives. In this paper, we introduce FlashAR, a lightweight post-training adaptation framework that efficiently adapts a pre-trained raster-scan autoregressive model into a highly parallel generator based on two-way next-token prediction. Our key insight is that effective adaptation should minimize modifications to the pre-trained model's original training objective to preserve its learned prior. Accordingly, we retain the original AR head as a horizontal head for row-wise prediction and introduce a complementary, lightweight vertical head for column-wise prediction. To facilitate efficient adaptation, we branch the vertical head from an intermediate layer rather than the final layer, bypassing the inherent horizontal head bias. Moreover, since horizontal and vertical predictions capture complementary dependencies whose relative importance varies across target positions, we employ a learnable fusion gate to dynamically combine the two predictions at each position. To further reduce adaptation cost, we propose a two-stage adaptation pipeline: the vertical head is first initialized through adaptation from the pre-trained autoregressive model before jointly fine-tuned with backbone to adapt to the new decoding paradigm. Extensive experiments on LlamaGen and Emu3.5 show that FlashAR achieves up to a 22.9x speedup for 512x512 image generation through a lightweight post-training with merely 0.05% of the original training data.

图像生成自回归加速后训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。