arXiv:2410.19310cs.CVcs.AI2024-10被引 29

将流匹配模型采样从多步加速至单步,性能不降反升。

Flow Generator Matching

  • 提出流生成器匹配算法,实现单步采样
  • CIFAR10上达3.08的FID新纪录,超越原50步模型
  • 可高效蒸馏Stable Diffusion 3,生成质量媲美多步模型

在人工智能生成内容(AIGC)领域,流匹配模型因其坚实的理论基础和强大的大规模生成能力而备受关注。然而,其采样过程依赖多步数值常微分方程(ODE),计算开销巨大。本文提出流生成器匹配(FGM),一种具有理论保障的新方法,可将流匹配模型的采样过程压缩为单步生成,同时保持原始性能。在无条件生成的CIFAR10基准上,单步FGM模型达到3.08的弗雷歇初始距离(FID)新纪录,优于原50步流匹配模型。此外,我们将FGM用于蒸馏基于MM-DiT架构的领先文本到图像流匹配模型Stable Diffusion 3。所得的MM-DiT-FGM单步文本到图像模型在GenEval基准上表现出色,生成质量媲美其他多步模型,兼具行业级表现与单步生成效率。

原文摘要 · Abstract (English)

In the realm of Artificial Intelligence Generated Content (AIGC), flow-matching models have emerged as a powerhouse, achieving success due to their robust theoretical underpinnings and solid ability for large-scale generative modeling. These models have demonstrated state-of-the-art performance, but their brilliance comes at a cost. The process of sampling from these models is notoriously demanding on computational resources, as it necessitates the use of multi-step numerical ordinary differential equations (ODEs). Against this backdrop, this paper presents a novel solution with theoretical guarantees in the form of Flow Generator Matching (FGM), an innovative approach designed to accelerate the sampling of flow-matching models into a one-step generation, while maintaining the original performance. On the CIFAR10 unconditional generation benchmark, our one-step FGM model achieves a new record Fréchet Inception Distance (FID) score of 3.08 among few-step flow-matching-based models, outperforming original 50-step flow-matching models. Furthermore, we use the FGM to distill the Stable Diffusion 3, a leading text-to-image flow-matching model based on the MM-DiT architecture. The resulting MM-DiT-FGM one-step text-to-image model demonstrates outstanding industry-level performance. When evaluated on the GenEval benchmark, MM-DiT-FGM has delivered remarkable generating qualities, rivaling other multi-step models in light of the efficiency of a single generation step.

流匹配单步生成Stable Diffusion文本到图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。