让模型一步从潜在空间生成像素图像,省去解码器
CrossFlow: One-Step Generation Across Latent and Pixel Spaces

- 用跨空间流模型直接从潜在表示生成图像
- 256×256 图像上达1.62 FID,仅需一次前向计算
- 适合追求高效高质图像生成的开发者
多数扩散和流匹配生成器在相同表示空间定义先验、概率路径与预测目标。潜变量扩散通过将路径移入自编码器潜空间提升效率,但最终样本仍由独立训练的解码器生成。这种分离导致不匹配:生成器优化于潜空间预测,而最终质量取决于解码器处理偏离干净编码输出的潜变量的能力。我们提出CrossFlow,一种跨空间流形式,可将噪声潜变量直接映射至像素空间图像。关键技术是无速度的一步目标:潜变量轨迹定义训练路径,但监督预测为图像而非潜变量位移。这使得单一模型既可作为一步潜变量到像素的生成器,也可作为潜变量扩散流水线的解码器替代品。在256×256的分类条件ImageNet-1k上,CrossFlow-XL实现1.62 FID,仅需一次函数评估。消融实验表明潜变量编码器以及像素空间感知和对抗损失对保真度至关重要。结果表明,跨空间流目标可在保持潜变量表示效率的同时,实现直接像素空间监督,无需推理时使用独立解码器。
原文摘要 · Abstract (English)
Most diffusion and flow-matching generators define the prior, probability path, and prediction target in the same representation space. Latent diffusion improves efficiency by moving this path into an autoencoder latent space, but the final sample is still produced by a separately trained decoder. This separation creates a mismatch: the generator is optimized for latent-space prediction, while final quality depends on how the decoder handles generated latents that may differ from clean encoder outputs. We introduce CrossFlow, a cross-space flow formulation that maps noisy latent inputs directly to pixel-space images. The key technical step is a velocity-free one-step objective: the latent trajectory defines the training path, but the supervised prediction is an image rather than a latent displacement. This lets one model act both as a one-step latent-to-pixel generator and as a decoder replacement for latent diffusion pipelines. On class-conditional ImageNet-1k at $256\times256$, CrossFlow-XL achieves 1.62 FID with one function evaluation. Ablations show that the latent encoder and pixel-space perceptual and adversarial losses are important for fidelity. These results indicate that cross-space flow objectives can combine the efficiency of latent representations with direct pixel-space supervision, without requiring a separate decoder at inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。