通过频率感知机制提升图像生成质量,让细节更清晰、结构更连贯。
Frequency-Aware Flow Matching for High-Quality Image Generation

- 分频支路分别处理高低频信息,引导生成过程
- 在ImageNet-256上达到1.38的FID,领先现有模型
- 适合追求高保真图像生成的研究者与开发者
流匹配模型通过学习逆转逐步添加高斯噪声的破坏过程,实现逼真的图像生成。然而,由于噪声在隐空间中注入,对不同频率成分的影响不均:推理时模型先生成低频成分(全局结构),高频成分(细节)仅在后期出现。针对此问题,我们提出频率感知流匹配(FreqFlow),通过时间依赖的自适应加权,在流匹配框架中显式引入频率感知条件。设计双分支架构:(1) 频率分支分别处理高低频成分,捕捉整体结构并优化纹理与边缘;(2) 空间分支在隐空间中合成图像,由频率分支输出引导。显式融合频率信息后,低频条件强化全局一致性,高频条件提升纹理保真度与细节锐度。在类别条件的ImageNet-256生成任务中,本方法取得1.38的FID,优于先前扩散模型DiT和流匹配模型SiT,分别降低0.79和0.58 FID。代码已开源。
原文摘要 · Abstract (English)
Flow matching models have emerged as a powerful framework for realistic image generation by learning to reverse a corruption process that progressively adds Gaussian noise. However, because noise is injected in the latent domain, its impact on different frequency components is non-uniform. As a result, during inference, flow matching models tend to generate low-frequency components (global structure) in the early stages, while high-frequency components (fine details) emerge only later in the reverse process. Building on this insight, we propose Frequency-Aware Flow Matching (FreqFlow), a novel approach that explicitly incorporates frequency-aware conditioning into the flow matching framework via time-dependent adaptive weighting. We introduce a two-branch architecture: (1) a frequency branch that separately processes low- and high-frequency components to capture global structure and refine textures and edges, and (2) a spatial branch that synthesizes images in the latent domain, guided by the frequency branch's output. By explicitly integrating frequency information into the generation process, FreqFlow ensures that both large-scale coherence and fine-grained details are effectively modeled low-frequency conditioning reinforces global structure, while high-frequency conditioning enhances texture fidelity and detail sharpness. On the class-conditional ImageNet-256 generation benchmark, our method achieves state-of-the-art performance with an FID of 1.38, surpassing the prior diffusion model DiT and flow matching model SiT by 0.79 and 0.58 FID, respectively. Code is available at https://github.com/OliverRensu/FreqFlow.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。