通过预条件化改善流匹配的优化瓶颈,提升生成质量与收敛速度。
Preconditioned Flow Matching
- 先对分布做预条件变换,再在更均匀的空间中训练流模型
- 在高维图像数据上显著提升FID、MMD、精度与召回率
- 适用于高分辨率图像生成,尤其对病态条件问题敏感的场景
流匹配(FM)通过沿中间分布 $p_t$ 回归随机速度目标来学习向量场。我们发现该回归问题存在几何优化瓶颈:当 $p_t$ 的协方差 $Σ_t$ 病态时,梯度训练会快速拟合高方差方向,而低方差方向进展缓慢。在可解析的高斯设定下,证明过拟合风险被 $Σ_t$ 加权,且梯度下降与随机梯度下降均受条件数影响收敛。进一步分析高斯混合模型表明,多模态不会消除此效应;最慢且条件最差的成分可能主导优化。为此,提出预条件流匹配:先将目标分布转换为更各向同性的表示,在变换空间中训练主流模型,并通过逆变换映射生成样本。理论上证明预条件化重塑了中间FM路径并改善其条件性。在可控高斯、高斯混合实验,以及潜在空间MNIST和最高达 $512{ imes}512$ 分辨率的图像数据集上,预条件化显著改善路径条件性诊断、低特征值恢复、FID、MMD、精度与召回率。计算量匹配的基线与预条件器质量消融实验表明,性能提升并非仅由额外参数导致,而是源于下游流匹配问题几何结构的优化。
原文摘要 · Abstract (English)
Flow matching (FM) learns vector fields by regressing stochastic velocity targets along intermediate distributions $p_t$. We identify a geometric optimization bottleneck in this regression problem: when the covariance $Σ_t$ of $p_t$ is ill-conditioned, gradient-based training rapidly fits high-variance directions while making slow progress along low-variance ones. In an exactly solvable Gaussian setting, we prove that the excess risk is weighted by $Σ_t$, and that both gradient descent and stochastic gradient descent inherit condition-number-dependent convergence. We then extend the analysis to Gaussian mixtures, showing that multimodality does not average away this effect; instead, the slowest and worst-conditioned component can control optimization. Motivated by this analysis, we propose \emph{preconditioned flow matching}, a precondition-then-match framework that transforms the target distribution into a more isotropic representation, trains the main flow in the transformed space, and maps generated samples back through the inverse transformation. We show theoretically that preconditioning reshapes the intermediate FM path and improves its conditioning. Across controlled Gaussian and Gaussian-mixture experiments, latent MNIST and other high resolution image datasets up to $512{\times}512$ resolution, preconditioning improves path-conditioning diagnostics, low-eigenvalue recovery, FID, MMD, precision, and recall. Compute-matched baselines and preconditioner-quality ablations further show that the gains are not explained merely by additional preconditioner parameters, but by improved geometry of the downstream flow matching problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。