arXiv:2602.12640cs.CV2026-02

用检索增强加速文本到图像生成,一步出图且质量不降。

ImageRAGTurbo: Towards One-step Text-to-Image Generation with Retrieval-Augmented Diffusion Models

  • 从数据库检索图文对,用以指导扩散模型去噪
  • 一步生成图像,保真度优于现有方法
  • 适合需要快速出图的AI绘画场景

扩散模型是当前文本到图像生成的主流方法,但其迭代采样过程带来显著延迟。尽管已有少步扩散模型将采样步骤减少至1至4步,但在一步生成时常牺牲图像质量和提示对齐度,且训练成本高昂。为此,我们提出ImageRAGTurbo,一种通过检索增强实现高效微调少步扩散模型的新方法。给定文本提示,系统从数据库中检索相关图文对,并将其用于条件生成。我们认为这些检索样本为UNet去噪器提供了丰富的上下文信息,有助于在不降低图像质量的前提下减少去噪步骤。初步实验表明,仅通过修改去噪器的潜在空间($/mathcal{H}$-space)即可提升提示保真度。为进一步提升生成质量,我们在$/mathcal{H}$-space中引入可训练适配器,利用交叉注意力机制融合检索内容与目标提示。在快速文本到图像生成任务上的实验结果表明,该方法在保持低延迟的同时生成高保真图像,性能优于现有方法。

原文摘要 · Abstract (English)

Diffusion models have emerged as the leading approach for text-to-image generation. However, their iterative sampling process, which gradually morphs random noise into coherent images, introduces significant latency that limits their applicability. While recent few-step diffusion models reduce the number of sampling steps to as few as one to four steps, they often compromise image quality and prompt alignment, especially in one-step generation. Additionally, these models require computationally expensive training procedures. To address these limitations, we propose ImageRAGTurbo, a novel approach to efficiently finetune few-step diffusion models via retrieval augmentation. Given a text prompt, we retrieve relevant text-image pairs from a database and use them to condition the generation process. We argue that such retrieved examples provide rich contextual information to the UNet denoiser that helps reduce the number of denoising steps without compromising image quality. Indeed, our initial investigations show that using the retrieved content to edit the denoiser's latent space ($\mathcal{H}$-space) without additional finetuning already improves prompt fidelity. To further improve the quality of the generated images, we augment the UNet denoiser with a trainable adapter in the $\mathcal{H}$-space, which efficiently blends the retrieved content with the target prompt using a cross-attention mechanism. Experimental results on fast text-to-image generation demonstrate that our approach produces high-fidelity images without compromising latency compared to existing methods.

文本生成图像扩散模型检索增强快速生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。