不训练即可优化生成路径,让图像更清晰
Look-Ahead and Look-Back Flows: Training-Free Image Generation with Trajectory Smoothing
- 用未来和过去信息直接修正潜在空间轨迹
- 在多个数据集上超越现有最优模型
- 适合追求高效生成的开发者与研究者
近期研究将扩散模型重新表述为确定性常微分方程(ODE),通过流匹配框架统一噪声到数据的生成过程。各类无需训练的流匹配方法通过调整流速度场提升图像生成质量,避免昂贵重训练。然而,修改速度场 $v$ 会引入误差并沿生成路径累积;而对潜在轨迹 $z$ 的调整可被预训练速度网络自然修正,减少误差积累。本文提出两种互补的无训练潜在轨迹调整方法:基于未来和过去速度 $v$ 与潜在轨迹 $z$ 信息,直接在潜在空间中优化生成路径。我们设计了两种无训练轨迹平滑方案: - Look-Ahead:使用曲率门控权重平均当前与下一步潜在表示; - Look-Back:采用指数移动平均结合衰减因子平滑潜在表示。 大量实验与综合评估指标表明,所提方法在 COCO17、CUB-200 与 Flickr30K 等多个数据集上显著优于多种先进模型。
原文摘要 · Abstract (English)
Recent advances have reformulated diffusion models as deterministic ordinary differential equations (ODEs) through the framework of flow matching, providing a unified formulation for the noise-to-data generative process. Various training-free flow matching approaches have been developed to improve image generation through flow velocity field adjustment, eliminating the need for costly retraining. However, Modifying the velocity field $v$ introduces errors that propagate through the full generation path, whereas adjustments to the latent trajectory $z$ are naturally corrected by the pretrained velocity network, reducing error accumulation. In this paper, we propose two complementary training-free latent-trajectory adjustment approaches based on future and past velocity $v$ and latent trajectory $z$ information that refine the generative path directly in latent space. We propose two training-free trajectory smoothing schemes: \emph{Look-Ahead}, which averages the current and next-step latents using a curvature-gated weight, and \emph{Look-Back}, which smoothes latents using an exponential moving average with decay. We demonstrate through extensive experiments and comprehensive evaluation metrics that the proposed training-free trajectory smoothing models substantially outperform various state-of-the-art models across multiple datasets including COCO17, CUB-200, and Flickr30K.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。