arXiv:2504.20179cs.CVcs.AI2025-04被引 1

提出积分流模型,让生成模型一步到位且更稳定可靠。

Integration Flow Models

  • 直接学习ODE轨迹的积分,不依赖数值求解器
  • 在CIFAR10上实现单步生成,FID低至2.86
  • 首次证明1-修正流的精确直线性,适合高质生成任务

基于常微分方程(ODE)的生成模型在多个应用中展现出强大生成能力。然而,现有方法或受数值求解器离散化误差限制,导致使用少量NFE时样本质量下降;或面临训练不稳定的难题。本文提出积分流(Integration Flow),直接学习ODE轨迹的积分,无需求解ODE函数。同时,显式将目标状态𝐱₀作为反向动力学的锚点,理论上证明该设计可提升训练稳定性和生成精度。据我们所知,积分流是首个统一结构的ODE生成模型,也是首个展示1-修正流精确直线性的模型(无需重流)。通过理论分析与实证评估,发现其可显著提升现有模型性能:在CIFAR10上,对变异数爆炸(VE)扩散模型、无重流修正流、PFGM++分别实现单步生成,FID分别为2.86、3.36、2.91;在ImageNet上,对应FID为4.09、4.35、4.15。

原文摘要 · Abstract (English)

Ordinary differential equation (ODE) based generative models have emerged as a powerful approach for producing high-quality samples in many applications. However, the ODE-based methods either suffer the discretization error of numerical solvers of ODE, which restricts the quality of samples when only a few NFEs are used, or struggle with training instability. In this paper, we proposed Integration Flow, which directly learns the integral of ODE-based trajectory paths without solving the ODE functions. Moreover, Integration Flow explicitly incorporates the target state $\mathbf{x}_0$ as the anchor state in guiding the reverse-time dynamics. We have theoretically proven this can contribute to both stability and accuracy. To the best of our knowledge, Integration Flow is the first model with a unified structure to estimate ODE-based generative models and the first to show the exact straightness of 1-Rectified Flow without reflow. Through theoretical analysis and empirical evaluations, we show that Integration Flows achieve improved performance when it is applied to existing ODE-based models, such as diffusion models, Rectified Flows, and PFGM++. Specifically, Integration Flow achieves one-step generation on CIFAR10 with FIDs of 2.86 for the Variance Exploding (VE) diffusion model, 3.36 for rectified flow without reflow, and 2.91 for PFGM++; and on ImageNet with FIDs of 4.09 for VE diffusion model, 4.35 for rectified flow without reflow and 4.15 for PFGM++.

生成模型ODE生成积分流单步生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。