arXiv:2603.02829cs.CVcs.LG2026-03

用生成初期的特征提前判断图像质量,节省60%算力。

Toward Early Quality Assessment of Text-to-Image Diffusion Models

  • 从扩散模型早期步骤提取特征,预测最终图像质量
  • 仅需20%生成步数即可准确排序候选图像,节省超60%计算成本
  • 适合需要高效生成高质量图像的场景,如大规模图像合成

近期文本到图像(T2I)扩散模型与流匹配模型能根据自然语言提示生成高度逼真的图像。在实际应用中,系统常采用“生成-筛选”模式:生成多个随机种子,仅保留少数优质图像。但该流程资源消耗大,每个候选图像需数十至上百次去噪步骤,且评估指标如CLIPScore和ImageReward为事后评估。本文提出Probe-Select——一个可插入式模块,可在生成过程中实现高效图像质量评估。我们发现,即使在早期时间步,某些去噪器激活值也已编码出稳定的粗略结构、物体布局与空间关系,与最终图像保真度强相关。Probe-Select利用这一特性,直接从早期激活值预测最终质量得分,从而提前终止劣质种子。在多种扩散与流匹配模型上,实验表明仅使用20%生成轨迹即可准确排序候选种子并实现选择性继续。该策略在降低超过60%采样成本的同时提升保留图像质量,证明早期结构信号可有效引导选择性生成,无需修改原有生成模型。代码已公开于https://github.com/Guhuary/ProbeSelect。

原文摘要 · Abstract (English)

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled and only a few images are kept for use. However, this pipeline is highly resource-intensive since each candidate requires tens to hundreds of denoising steps, and evaluation metrics such as CLIPScore and ImageReward are post-hoc. In this work, we address this inefficiency by introducing Probe-Select, a plug-in module that enables efficient evaluation of image quality within the generation process. We observe that certain intermediate denoiser activations, even at early timesteps, encode a stable coarse structure, object layout and spatial arrangement--that strongly correlates with final image fidelity. Probe-Select exploits this property by predicting final quality scores directly from early activations, allowing unpromising seeds to be terminated early. Across diffusion and flow-matching backbones, our experiments show that early evaluation at only 20\% of the trajectory accurately ranks candidate seeds and enables selective continuation. This strategy reduces sampling cost by over 60\% while improving the quality of the retained images, demonstrating that early structural signals can effectively guide selective generation without altering the underlying generative model. Code is available at https://github.com/Guhuary/ProbeSelect.

图像生成扩散模型效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。