arXiv:2505.18825cs.LGcs.CV2025-05NeurIPS被引 89

提出统一框架,直接训练一致性模型的流映射,提升生成效率与稳定性。

How to build a consistency model: Learning flow maps via self-distillation

  • 通过自蒸馏将任意蒸馏方案转为直接训练算法,无需预训练教师模型。
  • 三种新方法中拉格朗日类在稳定性和性能上显著优于传统欧拉与渐进方法。
  • 揭示加速生成建模的新设计原则,适合追求高效生成的从业者。

基于流的生成模型虽能实现顶尖样本质量,但推理时需解微分方程,代价高昂。流映射模型(即一致性模型)通过学习该微分方程的解算子,旨在提升推理效率。然而现有方法缺乏统一的实践训练范式。本文基于Boffi等(2024)的方法,提出系统性算法框架,直接学习流或扩散模型对应的流映射。利用连续时间流的速率场与流映射瞬时变化率之间的关系,通过自蒸馏将任意蒸馏方案转化为直接训练算法,无需预训练教师模型。我们提出三类基于不同数学表征的算法:欧拉型、拉格朗日型和渐进型,涵盖并扩展了所有已知的一致性模型蒸馏与直接训练方法。实验表明,拉格朗日型方法因规避空间导数与小步递推,训练更稳定,性能更优。本方法统一现有训练范式,揭示加速生成建模的新设计原则。相关代码已开源:https://github.com/nmboffi/flow-maps。

原文摘要 · Abstract (English)

Flow-based generative models achieve state-of-the-art sample quality, but require the expensive solution of a differential equation at inference time. Flow map models, commonly known as consistency models, encompass many recent efforts to improve inference-time efficiency by learning the solution operator of this differential equation. Yet despite their promise, these models lack a unified description that clearly explains how to learn them efficiently in practice. Here, building on the methodology proposed in Boffi et. al. (2024), we present a systematic algorithmic framework for directly learning the flow map associated with a flow or diffusion model. By exploiting a relationship between the velocity field underlying a continuous-time flow and the instantaneous rate of change of the flow map, we show how to convert any distillation scheme into a direct training algorithm via self-distillation, eliminating the need for pre-trained teachers. We introduce three algorithmic families based on different mathematical characterizations of the flow map: Eulerian, Lagrangian, and Progressive methods, which we show encompass and extend all known distillation and direct training schemes for consistency models. We find that the novel class of Lagrangian methods, which avoid both spatial derivatives and bootstrapping from small steps by design, achieve significantly more stable training and higher performance than more standard Eulerian and Progressive schemes. Our methodology unifies existing training schemes under a single common framework and reveals new design principles for accelerated generative modeling. Associated code is available at https://github.com/nmboffi/flow-maps.

一致性模型生成模型自蒸馏流映射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。