arXiv:2605.18267cs.CV2026-05

用压缩语义空间提升生成模型质量,让流模型更高效

SRC-Flow: Compact Semantic Representations Enable Normalizing Flows for Image Generation

论文配图:SRC-Flow: Compact Semantic Representations Enable Normalizing Flows for Image Generation
图 1 · 摘自论文原文
  • 先压缩高维特征到低维语义空间再建模流
  • 在ImageNet上达当前流模型最佳生成质量
  • 适合追求精确概率与可逆采样的研究者

归一化流(NFs)具备精确似然和确定性可逆采样,但在大规模图像生成上长期落后于扩散模型。我们识别出关键障碍:NFs需在整个高维空间学习单一可逆变换,对高维表示极度敏感,导致现代视觉表征中语义信息紧凑但编码于过完备特征中,存在语义容量不匹配问题。为此提出SRC-Flow,引入语义表征压缩器(SRC),将高维RAE特征压缩至低维语义空间后进行流建模,并通过冻结的RAE解码器保持重建能力。该紧凑空间显著降低流模型建模负担,实现在语义空间中的有效似然生成。进一步采用针对固定无条件双射的常数噪声正则化。在ImageNet $256 \times 256$ 和 $512 \times 512$ 上,SRC-Flow 在归一化流方法中达到最优生成质量,分类器无关引导下分别取得1.65和2.07的gFID分数,同时保留紧凑语义空间中的精确似然计算与流级别的确定性可逆采样。代码与模型将开源于https://github.com/longtaojiang/SRC-Flow。

原文摘要 · Abstract (English)

Normalizing flows (NFs) provide exact likelihoods and deterministic invertible sampling, but have historically lagged behind diffusion models for large-scale image generation. We identify a key obstacle: NFs are required to learn a single invertible transport over the full ambient space, making them highly sensitive to high-dimensional representations. This leads to a semantic-capacity mismatch in modern visual representation spaces, where semantic information is compact but encoded in overcomplete features. We propose SRC-Flow, which introduces a Semantic Representation Compressor (SRC) to compact high-dimensional RAE features into a low-dimensional semantic space before flow modeling and preserve reconstruction through the frozen RAE decoder. This compact space reduces the modeling burden of NFs and enables effective likelihood-based generation in semantic representation space. We further adopt constant noise regularization tailored to the fixed unconditional bijection learned by flows. On ImageNet $256 \times 256$ and $512 \times 512$, SRC-Flow achieves state-of-the-art generation quality among normalizing flow methods, with gFID scores of 1.65 and 2.07 under classifier-free guidance, while retaining exact likelihood computation in the compact semantic representation space and deterministic invertible sampling at the flow level. Codes and models will be available at https://github.com/longtaojiang/SRC-Flow.

生成模型归一化流语义压缩图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。