arXiv:2412.18730cs.LG2024-12中稿 · ICML被引 1

揭示流匹配模型如何随数据几何结构演化,提升采样质量与稳定性。

Elucidating Flow Matching ODE Dynamics with Respect to Data Geometries and Denoisers

  • 发现去噪器通过吸引与吸收机制引导轨迹适应数据几何结构。
  • 证明在弱假设下,低维流形上的样本轨迹仍能收敛,突破前人局限。
  • 成果适用于优化采样策略和架构设计,尤其适合几何复杂的数据

流匹配(Flow Matching, FM)模型将基于常微分方程(ODE)的扩散模型扩展为通用框架,通过学习向量场显著减少采样步数。然而,其理论理解,尤其是样本轨迹如何与底层数据几何相互作用,仍不充分。本文对FM ODE进行系统性理论分析,核心发现是:去噪器通过吸引与吸收行为引导ODE动态,自适应于数据几何。我们识别出三阶段演化过程:初始与中间阶段,轨迹趋向数据均值与局部聚类;终端阶段,在弱假设下严格证明了收敛性,涵盖数据位于低维子流形的情形——这是此前理论无法处理的场景。该分析揭示了记忆现象成因,并建立FM ODE的等变性性质。研究成果填补了流匹配理论的关键空白,对基于数据内在几何优化采样策略与模型架构具有重要实践意义。

原文摘要 · Abstract (English)

Flow matching (FM) models extend ODE sampler based diffusion models into a general framework, significantly reducing sampling steps through learned vector fields. However, the theoretical understanding of FM models, particularly how their sample trajectories interact with underlying data geometry, remains underexplored. A rigorous theoretical analysis of FM ODE is essential for sample quality, stability, and broader applicability. In this paper, we advance the theory of FM models through a comprehensive analysis of sample trajectories. Central to our theory is the discovery that the denoiser, a key component of FM models, guides ODE dynamics through attracting and absorbing behaviors that adapt to the data geometry. We identify and analyze the three stages of ODE evolution: in the initial and intermediate stages, trajectories move toward the mean and local clusters of the data. At the terminal stage, we rigorously establish the convergence of FM ODE under weak assumptions, addressing scenarios where the data lie on a low-dimensional submanifold-cases that previous results could not handle. Our terminal stage analysis offers insights into the memorization phenomenon and establishes equivariance properties of FM ODEs. These findings bridge critical gaps in understanding flow matching models, with practical implications for optimizing sampling strategies and architectures guided by the intrinsic geometry of data.

流匹配数据几何扩散模型ODE分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。