arXiv:2508.08735cs.LG2025-08被引 3

首次证明了确定性采样下多步与单步修正流模型的多项式离散复杂度。

Elucidating Rectified Flow with Deterministic Sampler: Polynomial Discretization Complexity for Multi and One-step Models

  • 基于预测-校正框架,引入朗之万过程提升多步模型性能。
  • 在有界支撑假设下,多步与单步模型复杂度均为多项式,优于指数级结果。
  • 为修正流模型的优异实证表现提供了首个理论解释,适合关注生成模型理论的研究者。

近期,基于修正流(Rectified Flow, RF)的模型在多步和单步生成任务中均取得了顶尖性能。然而,现有理论研究对RF模型的离散复杂度分析仍有限。已有工作或聚焦于随机采样的流模型,或得出对问题参数呈指数依赖的复杂度结论。本文在现实的有界支撑假设下,首次同时证明了多步与单步RF模型在确定性采样下的多项式离散复杂度。针对多步情形,受扩散模型预测-校正框架启发,引入朗之万过程作为校正项,表明RF模型可实现比扩散模型更优的多项式复杂度。通过细致分析RF模型机制,解释其优于常见方差保持(VP)和方差爆炸(VE)模型的原因。基于多步模型的观察,进一步首次给出单步RF模型的多项式复杂度结果,超越先前单步扩散模型的成果。这些发现标志着理解RF模型在多步与单步生成中卓越表现的第一步。

原文摘要 · Abstract (English)

Recently, rectified flow (RF)-based models have achieved state-of-the-art performance in many areas for both the multi-step and one-step generation. However, only a few theoretical works analyze the discretization complexity of RF-based models. Existing works either focus on flow-based models with stochastic samplers or establish complexity results that exhibit exponential dependence on problem parameters. In this work, under the realistic bounded support assumption, we prove the first polynomial discretization complexity for multi-step and one-step RF-based models with a deterministic sampler simultaneously. For the multi-step setting, inspired by the predictor-corrector framework of diffusion models, we introduce a Langevin process as a corrector and show that RF-based models can achieve better polynomial discretization complexity than diffusion models. To achieve this result, we conduct a detailed analysis of the RF-based model and explain why it is better than previous popular models, such as variance preserving (VP) and variance exploding (VE)-based models. Based on the observation of multi-step RF-based models, we further provide the first polynomial discretization complexity result for one-step RF-based models, improving upon prior results for one-step diffusion-based models. These findings mark the first step toward theoretically understanding the impressive empirical performance of RF-based models in both multi-step and one-step generation.

生成模型修正流理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。