发现潜在流匹配模型具稳定性,可大幅节省训练数据与推理成本。
Exploring and Exploiting Stability in Latent Flow Matching

- 利用模型对扰动的鲁棒性,实现小数据训练仍保持高质量。
- 在计算受限下,训练速度更快,推理效率提升两倍以上。
- 适合资源有限场景,尤其适用于需高效生成的应用。
本文发现潜在流匹配(LFM)模型对多种扰动具有鲁棒性,包括数据量减少和模型容量缩小。通过相同噪声种子生成相似输出的现象,我们将其与流匹配理论关联,表明该稳定性是FM目标的内在属性。基于此,提出两项实用算法:其一,在显著缩减的数据集上训练,仍能保持性能,加速收敛并减少标注负担;其二,采用轻量级与高容量模型分阶段构建流轨迹,显著降低推理开销。引入三种样本评分标准,在多个数据集上评估,结果表明该稳定性带来数据节约与超过两倍的推理加速,同时生成质量相当。
原文摘要 · Abstract (English)
In this work, we show that Latent Flow-Matching (LFM) models are robust to different types of perturbations, including data reduction and model capacity shrinkage. We characterize this stability by these models' tendency to generate similar outputs under identical noise seeds. We provide a perspective relating this phenomenon to flow matching theory, which indicates that this stability is inherent to the FM objective. We further exploit this stability to derive practical algorithms for more efficient training and inference. Concretely, first, we show that by training LFM models on significantly reduced datasets, performance is preserved, and in compute-constrained regimes, the model converges faster while maintaining quality. This yields multiple advantages, including savings in the training time due to faster convergence, and alleviating annotation effort when training conditional models. Second, LFM stability under architectural shrinkage gives rise to a two-model coarse-to-fine approach, one using a light-weight architecture for the first phase of the FM trajectory, and one with higher capacity for the second, thereby reducing the inference cost substantially. To determine which samples are informative, we introduce three sample-scoring criteria and evaluate them under standard metrics for generative models. Our results are thoroughly evaluated on multiple datasets, demonstrating the practical advantage of this stability, including data savings and a more than two-fold inference speedup while generating comparable outputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。