arXiv:2504.16080cs.CV2025-04ICCV被引 65

让文生图模型像人一样自我反思,逐步优化生成图像。

From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning

  • 引入三重推理时扩展:噪声、提示和反思层级,实现迭代修正。
  • 在100万组数据上训练,使FLUX.1-dev在复杂场景中显著提升画质。
  • 适合追求高精度图像生成的研究者与工业应用开发者。

近期文生图扩散模型通过大规模训练数据和参数量实现了出色的视觉质量,但在复杂场景和细节表现上仍存不足。受大语言模型自省能力启发,我们提出ReflectionFlow,一种推理时框架,使扩散模型能迭代反思并优化输出。该框架引入三个互补的推理时扩展维度:(1) 噪声级别扩展,优化潜在空间初始化;(2) 提示级别扩展,实现精准语义引导;最核心的是(3) 反思级别扩展,显式提供可操作的反思信息,以评估并修正先前生成结果。为支持反思级别扩展,我们构建了包含100万组三元组的GenRef数据集,每组包含一段反思文本、一张有缺陷的图像及一张改进后的图像。基于此数据集,我们在统一框架下对最先进的扩散变换器FLUX.1-dev进行高效反思微调。实验表明,ReflectionFlow显著优于简单的噪声级别扩展方法,在复杂任务中实现高质量图像合成,提供了一种可扩展且计算高效的解决方案。

原文摘要 · Abstract (English)

Recent text-to-image diffusion models achieve impressive visual quality through extensive scaling of training data and model parameters, yet they often struggle with complex scenes and fine-grained details. Inspired by the self-reflection capabilities emergent in large language models, we propose ReflectionFlow, an inference-time framework enabling diffusion models to iteratively reflect upon and refine their outputs. ReflectionFlow introduces three complementary inference-time scaling axes: (1) noise-level scaling to optimize latent initialization; (2) prompt-level scaling for precise semantic guidance; and most notably, (3) reflection-level scaling, which explicitly provides actionable reflections to iteratively assess and correct previous generations. To facilitate reflection-level scaling, we construct GenRef, a large-scale dataset comprising 1 million triplets, each containing a reflection, a flawed image, and an enhanced image. Leveraging this dataset, we efficiently perform reflection tuning on state-of-the-art diffusion transformer, FLUX.1-dev, by jointly modeling multimodal inputs within a unified framework. Experimental results show that ReflectionFlow significantly outperforms naive noise-level scaling methods, offering a scalable and compute-efficient solution toward higher-quality image synthesis on challenging tasks.

文生图扩散模型自我反思

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。