arXiv:2601.22495cs.LG2026-01

提出渐进微调方法,提升流模型在数据有限时的稳定性和生成质量。

Gradual Fine-Tuning for Flow Matching Models

  • 通过温度调控的中间目标序列,逐步逼近目标分布。
  • 相比其他方法,收敛更稳定,生成速度更快且多样性更高。
  • 适合数据分布变化大或计算资源受限的场景。

在数据有限、分布演化或计算资源受限的场景中,微调流匹配模型是一项核心挑战。尽管近期研究在基于奖励的微调方面取得进展,但现有方法在理论正确性及稳定性、效率和多样性保持方面的实证表现仍不理想。本文提出渐进微调(GFT),一种基于退火机制的简单而严谨的框架,仅需目标分布的样本即可微调流生成模型。对于随机流,GFT定义了一组受温度控制的中间目标,平滑插值预训练与目标漂移,理论上可随温度趋近零而逼近真实目标分布。我们分析表明,使用任意耦合(如最优传输)和少步推理方法可显著提升采样效率。实验结果表明,GFT在收敛稳定性、生成质量、训练速度和多样性方面均优于现有方法。该方法为应对分布偏移时流匹配模型的可扩展适配提供了一种理论坚实且实用有效的替代方案。

原文摘要 · Abstract (English)

Fine-tuning flow matching models is a central challenge in settings with limited data, evolving distributions, or computational constraints. While recent work has produced significant advances, particularly in the area of reward-based fine-tuning, current methods fail to demonstrate both theoretical correctness as well as strong empirical results in terms of stability, efficiency, and diversity preservation. In this work, we propose Gradual Fine-Tuning (GFT), a simple yet principled annealing-based framework for fine-tuning flow generative models when only samples from the target distribution are available. For stochastic flows, GFT defines a temperature-controlled sequence of intermediate objectives that smoothly interpolate between the pretrained and target drifts, provably approaching the true target as the temperature approaches zero. We analytically demonstrate that sample generation after GFT can be made substantially more efficient with the use of arbitrary (e.g., optimal transport) couplings, as well as by utilizing few-step inference methods. Empirically, GFT significantly improves convergence stability, while maintaining or improving generation quality, training speed, and generation diversity compared to other fine-tuning methods. Our results position GFT as a simple yet theoretically grounded and practically effective alternative for scalable adaptation of flow matching models under distribution shift.

流模型微调生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。