arXiv:2606.22568cs.CV2026-06

用语义优先扩散模型,以少得多的算力实现顶尖文生图效果。

SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion

论文配图:SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion
图 1 · 摘自论文原文
  • 提出语义优先扩散框架,提升训练效率
  • 50亿参数模型仅用12.5万小时显卡时,性能超同类大模型
  • 提供轻量加速版,适配不同硬件与速度需求

训练图像生成基础模型消耗大量资源。以往方法虽尝试利用语义引导加速训练,但实验仅限于ImageNet等简单数据集、低分辨率和小规模模型。本文提出SeFi-Image,一种基于语义优先扩散的新范式构建的文生图基础模型。我们实现了10亿、20亿和50亿参数三种规模的模型,系统研究缩放行为并支持不同算力下的灵活部署。值得注意的是,最大50亿参数模型仅使用12.5万次A800 GPU小时(约Z-Image的10-20%),却达到或超越Qwen-Image和Z-Image的性能。在GenEval、DPG、LongTextBench、OneIG和CVTG-2K等多个基准上表现强劲。此外,我们为各规模模型提供了经过DMD2蒸馏的少步加速版本,以适应多样化的硬件约束和延迟要求。代码与权重已公开,旨在为社区提供语义引导扩散建模的实践参考,并提供即用型模型选项。

原文摘要 · Abstract (English)

Training image generation foundation models consumes substantial resources. Previous methods have attempted to leverage semantic guidance to accelerate the training process, yet their experiments were only conducted on simple datasets such as ImageNet, at low resolutions, and with small-scale models. In this paper, we propose SeFi-Image, a text-to-image foundation model built upon semantic-first diffusion, a novel latent diffusion modeling paradigm. We instantiate SeFi-Image at three model scales, 1B, 2B, and 5B parameters, enabling systematic study of scaling behavior and flexible deployment under varying compute budgets. Notably, our largest 5B model was trained with merely 125K A800 GPU hours, corresponding to roughly 10-20% of the training compute used by Z-Image. However, it achieves results comparable to or even superior to Qwen-Image and Z-Image. Despite this modest training compute, SeFi-Image achieves strong performance on a wide range of benchmarks, including GenEval, DPG, LongTextBench, OneIG, and CVTG-2K. Moreover, we provide DMD2-distilled few-step turbo variants for each model scale to accommodate diverse hardware constraints and latency requirements. We publicly release our code, weights and hope this work offers the community useful insights into semantic-guided diffusion modeling for T2I generation, while also providing practical and readily deployable model options.

文生图扩散模型高效训练语义引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。