通过能量引导的端点演化,实现更清晰的图像生成轨迹。
Energy-Guided Flow Matching

- 用动态过滤端点替代固定终点,分步引导生成过程。
- 256×256下仅200轮即达FID 1.55,600轮时降至1.45。
- 适配高分辨率与文生图任务,性能领先且训练开销极低。
像素空间生成模型避免了有损的潜在压缩,但需在高维空间中联合学习全局结构与细粒度细节。标准流匹配将噪声插值至固定的干净图像终点,其频谱演化由模型隐式学习。本文提出能量引导流匹配(EG-FM),显式建模从粗到精的生成轨迹,通过移动终点实现。具体地,EG-FM用热核滤波终点替代固定终点,使其从低频图像平滑演化至干净图像。通过图像特定的能量调度,逐步释放终点中的高频信号,从而重新定向流匹配的速度。该框架无需调整主干网络或训练数据,对训练和推理开销几乎无影响。实验表明,EG-FM在ImageNet条件图像生成任务中,256×256分辨率下持续获得更低的FID,在200轮达到1.55,600轮降至1.45;继续在512×512分辨率上训练,仅40轮高分辨率微调即达FID 1.58。此外,将其迁移至文生图任务,取得GenEval分数0.85与DPG-Bench得分83.9。代码已公开于https://github.com/ysng123/EG-FM。
原文摘要 · Abstract (English)
Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly. In this paper, we introduce Energy-Guided Flow Matching(EG-FM) that explicitly models a coarse-to-fine generative trajectory by moving endpoint. Specifically, EG-FM replaces the fixed endpoint with a heat-kernel-filtered endpoint that evolves smoothly from low-frequency image to clean image. The fraction of high-frequency signal in moving endpoint is released by an image-specific energy-guided scheduling, leading to the re-targeting of velocity in flow matching. Our framework requires no adaptation of the backbone and training data, bringing negligible cost on the training and inference stages. In our experiment, EG-FM consistently achieves lower FID on the ImageNet class-conditional image generation task at $256 \times 256$ with fewer epochs, reaching an FID of 1.55 at 200 epochs and 1.45 at 600 epochs. We continue training the generation task on the setting of $512 \times 512$ resolution, yielding a FID of 1.58 after only 40 high-resolution adaptation epochs. Furthermore, we transfer EG-FM on text-to-image generation and achieve 0.85 on GenEval score and 83.9 on DPG-Bench. Code is available at https://github.com/ysng123/EG-FM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。