arXiv:2605.12951stat.MLcs.LG2026-05

用核心集构建生成模型的初始分布,提升采样效率与质量。

Coreset-Induced Conditional Velocity Flow Matching

论文配图:Coreset-Induced Conditional Velocity Flow Matching
图 1 · 摘自论文原文
  • 用熵正则Sinkhorn核心集压缩目标数据为加权原子,构造闭式先验分布。
  • 在相同架构下,少步生成效果媲美现有方法,且无需训练神经采样器。
  • 适合追求高效生成、减少训练成本的研究者或部署场景。

我们提出协同核心集条件速度流匹配(CCVFM),一种增强分层修正流的生成模型,其通过数据驱动的方式构建源分布。分层流建模了速度空间中的完整条件速度律,但其内部流需从零开始将各向同性高斯噪声映射到多模态目标速度分布。我们的关键观察是:该内源可被基于目标核心集的闭式近似替代。CCVFM首先使用熵正则的Sinkhorn核心集将目标压缩为加权原子,并将其提升为高斯混合模型。由此诱导的条件速度律为闭式高斯混合,可直接采样而无需学习神经采样器。一个轻量级校正流从该精确近似源中训练,仅优化剩余残差,而非学习完整的噪声到数据映射。我们证明,在显式压缩假设下,近似源的传输代价等于目标-近似间的Wasserstein差距;而噪声源版本具有维度相关的下界。进一步分析了直接近似源训练目标的条件二阶矩,表明当近似条件律在均值和协方差上接近真实条件速度律时,源相关过失较小。实验显示,在MNIST、CIFAR-10、ImageNet-32和CelebA-HQ上,该方法在相同架构下实现了具有竞争力的少步生成性能。

原文摘要 · Abstract (English)

We propose Coreset-Induced Conditional Velocity Flow Matching (CCVFM), a generative model that augments hierarchical rectified flow with a data-informed source distribution. Hierarchical flow matching models the full conditional velocity law in velocity space, but its inner flow is asked to transport isotropic Gaussian noise to a multimodal target velocity distribution from scratch. Our key observation is that this inner source can be replaced by a closed-form surrogate built from a coreset of the target. CCVFM first compresses the target into weighted atoms using an entropic Sinkhorn coreset and lifts them to a Gaussian mixture. The induced conditional velocity law is then a closed-form Gaussian mixture that can be sampled without a learned neural sampler. A lightweight correction flow, trained from this exact surrogate source, then refines the remaining surrogate-to-target residual rather than learning an entire noise-to-data map. We prove that the surrogate transport cost equals the target--surrogate Wasserstein gap under an explicit compression assumption, whereas the noise-source analogue has a dimension-scale lower bound. We further characterize the conditional second moment of the direct surrogate-source training target and show that its source-dependent excess is small when the surrogate conditional law is close to the true conditional velocity law in mean and covariance. Empirically, on MNIST, CIFAR-10, ImageNet-32, and CelebA-HQ, the proposed method reaches competitive few-step generation under matched architectures.

生成模型流匹配核心集高效采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。