arXiv:2512.18184cs.CV2025-12被引 5

探索图像流匹配的更好初始分布,提出可直接提升现有模型性能的新方法。

Is There a Better Source Distribution than Gaussian? Exploring Source Distributions for Image Flow Matching

  • 通过二维模拟分析高维流匹配的学习动态,发现高斯分布优势源于全向覆盖。
  • 提出归一化对齐+方向剪枝的框架,显著提升生成质量与采样效率。
  • 该剪枝策略可零成本适配任意高斯源训练的模型,无需重新训练。

流匹配作为强大的生成建模方法,其初始分布的选择具有灵活性。尽管高斯分布被广泛使用,但其在高维数据生成中是否为最优仍缺乏深入探索。本文提出一种新颖的二维模拟方法,以可解释的二维视角捕捉高维几何特性,从而分析流匹配训练过程中的学习动态。基于此,我们得出若干关键洞察:(1) 密度近似可能因模式差异反而损害性能;(2) 过度集中导致方向对齐受路径纠缠影响;(3) 高斯分布的全向覆盖保障了学习鲁棒性;(4) 范数错位带来巨大学习代价。据此,我们提出一个结合范数对齐训练与方向剪枝采样的实用框架。该方法保持流学习所需的全向监督,同时在推理阶段剔除数据稀疏区域的初始化。重要的是,该剪枝策略可应用于任何以高斯为源分布训练的流匹配模型,无需重训即可获得性能提升。实验表明,该方法在生成质量与采样效率上均实现一致改进。研究为源分布设计提供实用指导,并引入一种即插即用的技术以优化现有模型。代码已公开于 https://github.com/kwanseokk/SourceFM。

原文摘要 · Abstract (English)

Flow matching has emerged as a powerful generative modeling approach with flexible choices of source distribution. While Gaussian distributions are commonly used, the potential for better alternatives in high-dimensional data generation remains largely unexplored. In this paper, we propose a novel 2D simulation that captures high-dimensional geometric properties in an interpretable 2D setting, enabling us to analyze the learning dynamics of flow matching during training. Based on this analysis, we derive several key insights about flow matching behavior: (1) density approximation can paradoxically degrade performance due to mode discrepancy, (2) directional alignment suffers from path entanglement when overly concentrated, (3) Gaussian's omnidirectional coverage ensures robust learning, and (4) norm misalignment incurs substantial learning costs. Building on these insights, we propose a practical framework that combines norm-aligned training with directionally-pruned sampling. This approach maintains the robust omnidirectional supervision essential for stable flow learning, while eliminating initializations in data-sparse regions during inference. Importantly, our pruning strategy can be applied to any flow matching model trained with a Gaussian source, providing immediate performance gains without the need for retraining. Empirical evaluations demonstrate consistent improvements in both generation quality and sampling efficiency. Our findings provide practical insights and guidelines for source distribution design and introduce a readily applicable technique for improving existing flow matching models. Our code is available at https://github.com/kwanseokk/SourceFM.

流匹配生成模型分布设计采样优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。