arXiv:2505.21473cs.CV2025-05被引 18

用逐级细化的1D自回归方法,高效生成高质量图像。

DetailFlow: 1D Coarse-to-Fine Autoregressive Image Generation via Next-Detail Prediction

  • 通过渐进降质图像训练,实现从全局结构到细节的逐步生成。
  • 仅用128个令牌即达2.96 gFID,优于需680令牌的现有方法。
  • 支持并行推理,速度比同类方法快近2倍,适合高效生成场景。

本文提出DetailFlow,一种基于1D自回归机制的粗到精图像生成方法,通过新型的下一细节预测策略建模图像。该方法利用逐步降质的图像监督,学习具有分辨率感知能力的1D token序列,使生成过程从全局结构开始,逐步细化细节。这种粗到精的1D token序列与自回归推理机制高度契合,更自然高效地生成复杂视觉内容。我们的紧凑1D AR模型在显著减少令牌数量的前提下实现高质量图像合成,相比VAR/VQGAN大幅降低令牌需求。进一步提出带有自校正的并行推理机制,使生成速度提升约8倍,同时缓解教师强制监督带来的累积采样误差。在ImageNet 256x256基准上,本方法以128个令牌取得2.96 gFID,优于VAR(3.3 FID)和FlexVAR(3.05 FID),二者均需680个令牌。此外,因令牌数大幅减少及并行推理机制,本方法推理速度接近VAR和FlexVAR的2倍。大量实验表明,DetailFlow在生成质量与效率上均优于现有先进方法。

原文摘要 · Abstract (English)

This paper presents DetailFlow, a coarse-to-fine 1D autoregressive (AR) image generation method that models images through a novel next-detail prediction strategy. By learning a resolution-aware token sequence supervised with progressively degraded images, DetailFlow enables the generation process to start from the global structure and incrementally refine details. This coarse-to-fine 1D token sequence aligns well with the autoregressive inference mechanism, providing a more natural and efficient way for the AR model to generate complex visual content. Our compact 1D AR model achieves high-quality image synthesis with significantly fewer tokens than previous approaches, i.e. VAR/VQGAN. We further propose a parallel inference mechanism with self-correction that accelerates generation speed by approximately 8x while reducing accumulation sampling error inherent in teacher-forcing supervision. On the ImageNet 256x256 benchmark, our method achieves 2.96 gFID with 128 tokens, outperforming VAR (3.3 FID) and FlexVAR (3.05 FID), which both require 680 tokens in their AR models. Moreover, due to the significantly reduced token count and parallel inference mechanism, our method runs nearly 2x faster inference speed compared to VAR and FlexVAR. Extensive experimental results demonstrate DetailFlow's superior generation quality and efficiency compared to existing state-of-the-art methods.

图像生成自回归模型高效生成1D建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。