arXiv:2509.21906math.STcs.LG2025-09被引 6

首次系统分析离散流模型误差,揭示其理论优势与收敛性。

Error Analysis of Discrete Flow with Generator Matching

  • 基于随机微积分与生成器匹配,建立统一分析框架。
  • 给出非渐近误差界,样本量下收敛速度接近最优。
  • 适用于需精确分布建模的场景,如序列生成与状态空间学习。

离散流模型在离散状态空间分布学习中表现优异,但其收敛性与误差分析仍不明确。本文基于随机微积分理论,利用连续时间马尔可夫链路径测度的Girsanov型定理,系统分析了过渡率估计误差与早停误差。不同于离散扩散模型,离散流无因截断噪声过程时长带来的初始化误差。通过生成器匹配与均匀化方法,我们在无需原始转移率有界条件下,建立了分布估计的非渐近误差界;在有界条件下,还获得了更快的总变差收敛速率,接近最优。这是首个针对离散流模型的误差分析工作。模拟实验进一步验证了不同设置下的模型性能。

原文摘要 · Abstract (English)

Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error analysis remain largely unexplored. In this work, we develop a unified framework grounded in stochastic calculus theory to systematically investigate the theoretical properties of discrete flow models. Specifically, by leveraging a Girsanov-type theorem for the path measures of two continuous-time Markov chains (CTMCs), we present a comprehensive error analysis that accounts for both transition rate estimation error and early stopping error. In fact, the estimation error of transition rates has received little attention in existing works. Unlike discrete diffusion models, discrete flow incurs no initialization error caused by truncating the time horizon in the noising process. Building on generator matching and uniformization, we establish non-asymptotic error bounds for distribution estimation without the boundedness condition on oracle transition rates. Furthermore, we derive a faster rate of total variation convergence for the estimated distribution with the boundedness condition, yielding a nearly optimal rate in terms of sample size. Our results provide the first error analysis for discrete flow models. We also investigate model performance under different settings based on simulation results.

离散流误差分析生成器匹配马尔可夫链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。