提出新方法让生成模型走更直的路,少几步就能出好图。
Beyond Optimal Transport: Model-Aligned Coupling for Flow Matching
- 基于模型预测误差调整配对方式,使路径更符合模型偏好。
- 在3步生成时,样本质量超越现有方法,提升2.1个点(FID)。
- 只用误差最低的前k%数据训练,效率高且效果好,适合快速生成场景。
流匹配(Flow Matching, FM)是一种有效训练模型以学习向量场的方法,该向量场可将样本从源分布传输至目标分布。早期方法使用随机配对,常导致路径交叉,使模型学习非直线轨迹,需大量积分步数才能生成高质量样本。近期方法采用最优传输(OT)构建配对,通过最小化几何距离减少路径交叉。然而我们发现,此类基于几何的配对未必与模型偏好的传输方向一致,导致模型难以学习对应向量场,阻碍其学习直线轨迹。为此,我们提出模型对齐耦合(Model-Aligned Coupling, MAC),不仅考虑几何距离,还根据模型预测误差对配对进行对齐优化。为避免耗时的匹配过程,MAC仅选取预测误差最低的前-k%配对用于训练。大量实验表明,相比现有方法,MAC在少步生成设置下显著提升生成质量和效率,3步生成时FID降低2.1点。
原文摘要 · Abstract (English)
Flow Matching (FM) is an effective framework for training a model to learn a vector field that transports samples from a source distribution to a target distribution. To train the model, early FM methods use random couplings, which often result in crossing paths and lead the model to learn non-straight trajectories that require many integration steps to generate high-quality samples. To address this, recent methods adopt Optimal Transport (OT) to construct couplings by minimizing geometric distances, which helps reduce path crossings. However, we observe that such geometry-based couplings do not necessarily align with the model's preferred trajectories, making it difficult to learn the vector field induced by these couplings, which prevents the model from learning straight trajectories. Motivated by this, we propose Model-Aligned Coupling (MAC), an effective method that matches training couplings based not only on geometric distance but also on alignment with the model's preferred transport directions based on its prediction error. To avoid the time-costly match process, MAC proposes to select the top-$k$ fraction of couplings with the lowest error for training. Extensive experiments show that MAC significantly improves generation quality and efficiency in few-step settings compared to existing methods. Project page: https://yexionglin.github.io/mac
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。