arXiv:2503.09242cs.CV2025-03被引 4

用分阶段流模型加速图像生成,64%提速且保持高质量。

NAMI: Efficient Image Generation via Bridged Progressive Rectified Flow Transformers

  • 分阶段渐进式流架构,低分辨率用少层,高分辨率逐步增加层数。
  • 1024分辨率生成时推理时间减少64%,收敛更快。
  • 新设计的BridgeFlow模块对齐不同阶段流,适合高效生成场景。

基于流的Transformer模型在图像生成上达到顶尖性能,但常因参数量大导致推理延迟高、计算成本高。为在不损失质量的前提下提升效率,我们提出桥接渐进修正流Transformer(NAMI),将生成过程分解到时间、空间和结构维度。按分辨率划分修正流的不同阶段,并使用BridgeFlow模块连接各阶段。低分辨率阶段使用较少Transformer层生成图像布局与概念轮廓,随着分辨率提升逐步增加层数。实验表明,该方法实现快速收敛,显著降低推理时间并保证生成质量。主要贡献包括:(1) 提出支持多分辨率训练的桥接渐进修正流Transformer,加速模型收敛;(2) NAMI利用分段流与Diffusion Transformer(DiT)的空间级联,使1024分辨率图像生成推理时间减少64%;(3) 提出BridgeFlow模块以对齐不同阶段间的流;(4) 构建NAMI-1K基准测试集评估人类偏好表现,缓解分布偏差,全面评估模型有效性。结果表明,该模型在多项指标上具有竞争力。

原文摘要 · Abstract (English)

Flow-based Transformer models have achieved state-of-the-art image generation performance, but often suffer from high inference latency and computational cost due to their large parameter sizes. To improve inference efficiency without compromising quality, we propose Bridged Progressive Rectified Flow Transformers (NAMI), which decompose the generation process across temporal, spatial, and architectural demensions. We divide the rectified flow into different stages according to resolution, and use a BridgeFlow module to connect them. Fewer Transformer layers are used at low-resolution stages to generate image layouts and concept contours, and more layers are progressively added as the resolution increases. Experiments demonstrate that our approach achieves fast convergence and reduces inference time while ensuring generation quality. The main contributions of this paper are summarized as follows: (1) We introduce Bridged Progressive Rectified Flow Transformers that enable multi-resolution training, accelerating model convergence; (2) NAMI leverages piecewise flow and spatial cascading of Diffusion Transformer (DiT) to rapidly generate images, reducing inference time by 64% for generating 1024 resolution images; (3) We propose a BridgeFlow module to align flows between different stages; (4) We propose the NAMI-1K benchmark to evaluate human preference performance, aiming to mitigate distributional bias and comprehensively assess model effectiveness. The results show that our model is competitive with state-of-the-art models.

图像生成流模型Transformer加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。