arXiv:2604.18168cs.CV2026-04被引 3

将单步图像生成从类别标签扩展到文本条件,实现高效文本生成。

Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representation

论文配图:Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representation
图 1 · 摘自论文原文
  • 引入强文本编码器,适配单步生成框架提升语义区分度。
  • 首次实现仅一步生成的高质量文本条件图像合成。
  • 适用于需要快速生成的场景,如创意设计、原型开发。

少步生成是长期目标,近期基于均值流(MeanFlow)的单步生成方法取得了显著成果。现有研究多聚焦于类别到图像的生成,但将条件从固定类别标签扩展至灵活文本输入,可支持更丰富的内容创作。相比有限的类别标签,文本条件对模型理解能力要求更高,需有效整合强大文本编码器。然而,尽管文本条件看似直接,采用常规训练策略融合基于大语言模型(LLM)的文本编码器却导致性能不佳。通过详细分析发现,由于MeanFlow生成步骤极少(如仅一步),文本特征必须具备极高判别性。这也解释了为何离散且易区分的类别特征在该框架中表现良好。基于此,我们采用经验证具备所需语义特性的强大LLM文本编码器,并调整生成流程,首次实现高效文本条件合成。此外,在广泛使用的扩散模型上验证了该方法,显著提升生成性能。代码已开源:https://github.com/AMAP-ML/EMF。

原文摘要 · Abstract (English)

Few-step generation has been a long-standing goal, with recent one-step generation methods exemplified by MeanFlow achieving remarkable results. Existing research on MeanFlow primarily focuses on class-to-image generation. However, an intuitive yet unexplored direction is to extend the condition from fixed class labels to flexible text inputs, enabling richer content creation. Compared to the limited class labels, text conditions pose greater challenges to the model's understanding capability, necessitating the effective integration of powerful text encoders into the MeanFlow framework. Surprisingly, although incorporating text conditions appears straightforward, we find that integrating powerful LLM-based text encoders using conventional training strategies results in unsatisfactory performance. To uncover the underlying cause, we conduct detailed analyses and reveal that, due to the extremely limited number of refinement steps in the MeanFlow generation, such as only one step, the text feature representations are required to possess sufficiently high discriminability. This also explains why discrete and easily distinguishable class features perform well within the MeanFlow framework. Guided by these insights, we leverage a powerful LLM-based text encoder validated to possess the required semantic properties and adapt the MeanFlow generation process to this framework, resulting in efficient text-conditioned synthesis for the first time. Furthermore, we validate our approach on the widely used diffusion model, demonstrating significant generation performance improvements. We hope this work provides a general and practical reference for future research on text-conditioned MeanFlow generation. The code is available at https://github.com/AMAP-ML/EMF.

单步生成文本条件图像生成均值流

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。