arXiv:2509.25180cs.CVcs.AI2025-09被引 6

通过深度压缩潜在空间,实现4K图像生成53倍加速。

DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space

  • 用轻量对齐训练弥合基础模型与压缩潜空间的表示差距。
  • 在FLUX.1-Krea上实现4K生成53倍提速,仅需3.5秒。
  • 适合追求高效高分辨率生成的研究者与开发者。

现有文本到图像扩散模型虽能生成高质量图像,但在高分辨率(如4K)下效率低下。以往研究多从其他角度加速,却忽视了潜在空间中的固有冗余。本文提出DC-Gen,一种通用框架,通过深度压缩潜在空间加速文本到图像扩散模型。不同于耗时的从头训练,DC-Gen采用高效的后训练流程,在保持基模型质量的同时实现加速。关键挑战在于基模型潜空间与压缩潜空间间的表示差距,可能导致直接微调不稳定。为此,DC-Gen先通过轻量级嵌入对齐训练弥合该差距;对齐后仅需少量LoRA微调即可恢复基模型生成质量。我们在SANA和FLUX.1-Krea上验证了其有效性。结果表明,DC-Gen-SANA与DC-Gen-FLUX在质量接近基模型的前提下显著提速。特别是,DC-Gen-FLUX在NVIDIA H100 GPU上将4K图像生成延迟降低53倍。结合NVFP4 SVDQuant后,单块NVIDIA 5090 GPU仅需3.5秒生成4K图像,总延迟降低达138倍。代码已开源:https://github.com/dc-ai-projects/DC-Gen。

原文摘要 · Abstract (English)

Existing text-to-image diffusion models excel at generating high-quality images, but face significant efficiency challenges when scaled to high resolutions, like 4K image generation. While previous research accelerates diffusion models in various aspects, it seldom handles the inherent redundancy within the latent space. To bridge this gap, this paper introduces DC-Gen, a general framework that accelerates text-to-image diffusion models by leveraging a deeply compressed latent space. Rather than a costly training-from-scratch approach, DC-Gen uses an efficient post-training pipeline to preserve the quality of the base model. A key challenge in this paradigm is the representation gap between the base model's latent space and a deeply compressed latent space, which can lead to instability during direct fine-tuning. To overcome this, DC-Gen first bridges the representation gap with a lightweight embedding alignment training. Once the latent embeddings are aligned, only a small amount of LoRA fine-tuning is needed to unlock the base model's inherent generation quality. We verify DC-Gen's effectiveness on SANA and FLUX.1-Krea. The resulting DC-Gen-SANA and DC-Gen-FLUX models achieve quality comparable to their base models but with a significant speedup. Specifically, DC-Gen-FLUX reduces the latency of 4K image generation by 53x on the NVIDIA H100 GPU. When combined with NVFP4 SVDQuant, DC-Gen-FLUX generates a 4K image in just 3.5 seconds on a single NVIDIA 5090 GPU, achieving a total latency reduction of 138x compared to the base FLUX.1-Krea model. Code: https://github.com/dc-ai-projects/DC-Gen.

扩散模型4K生成加速潜空间压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。