arXiv:2512.16768stat.MLcs.LG2025-12被引 1

揭示流匹配采样器在有限样本下的隐藏偏差,解释为何结果会偏离预期。

On The Hidden Biases of Flow Matching Samplers

  • 用样本替代目标分布构建经验流匹配模型,形成渐进式偏差层级。
  • 发现经验最优解不一定是梯度场,且同一路径可对应多种粒子动力学。
  • 高斯基底能保证动能尾部指数衰减,适合需要稳定性的生成任务。

流匹配(Flow Matching, FM)通过设定从基分布到目标分布的连续时间概率路径来构建常微分方程(ODE)采样器。本文从有限样本插值估计的角度研究FM:除了用样本均值替代总体期望外,还可将目标分布替换为有限样本的代理分布,如经验分布或平滑估计量。这一视角自然导出一套经验FM模型的层次结构。对于仿射条件流,我们推导出精确的经验最小化解,并识别出一种平滑插值情形,此时终态分布恰好是核混合估计量。该插值视角澄清了多个耦合的有限样本偏差:第一,用样本代理替换目标分布会改变统计目标;第二,经验最小化解通常不是梯度场,即使每个条件流本身是;第三,固定的经验边缘路径不能唯一确定粒子动力学——可叠加任意零散度的向量场而不影响边缘路径。对高斯仿射条件路径,我们给出了此类无通量修正的显式族。最后,源分布是控制动能上尾部的关键机制:高斯基底带来瞬时与积分动能的指数上尾界,而多项式尾部基底则对应相应的多项式上尾界。

原文摘要 · Abstract (English)

Flow matching (FM) constructs continuous-time ODE samplers by prescribing probability paths between a base distribution and a target distribution. In this note, we study FM through the lens of finite-sample plug-in estimation. In addition to replacing population expectations by sample averages, one may replace the target distribution itself by a finite-sample surrogate, ranging from the empirical measure to a smoothed estimator. This viewpoint yields a natural hierarchy of empirical FM models. For affine conditional flows, we derive the exact empirical minimizer and identify a smoothed plug-in regime in which the terminal law is exactly a kernel-mixture estimator. This plug-in perspective clarifies several coupled finite-sample biases of empirical FM. First, replacing the target law by a finite-sample surrogate changes the statistical target. Second, the empirical minimizer is generally not a gradient field, even when each conditional flow is. Third, a fixed empirical marginal path does not determine a unique particle dynamics: one may add extra vector fields whose probability flux has zero divergence without changing the marginal path. For Gaussian affine conditional paths, we give explicit families of such flux-null corrections. Finally, the source distribution provides a primary mechanism controlling upper tails of kinetic energy. In particular, Gaussian bases yield exponential upper-tail bounds for instantaneous and integrated kinetic energies, whereas polynomially tailed bases yield corresponding polynomial upper-tail bounds.

生成模型流匹配偏差分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。