将分数蒸馏用于流匹配模型,实现快速图像生成
Score Distillation of Flow Matching Models
- 基于贝叶斯规则统一扩散与流匹配框架
- 无需微调教师模型,多款文生图流匹配模型即插即用
- 支持无数据与有数据设置,加速生成且保持质量
扩散模型生成图像质量高但采样慢。蒸馏方法可实现一步或几步生成以缓解此问题。流匹配作为独立框架,已被证明在高斯假设下与扩散模型理论等价,引发疑问:如分数蒸馏这类技术能否直接迁移?本文基于贝叶斯规则和条件期望,给出简洁推导,统一高斯扩散与流匹配,无需依赖常微分方程/随机微分方程形式。在此基础上,我们将分数身份蒸馏(SiD)扩展至预训练的文生图流匹配模型,包括 SANA、SD3-Medium、SD3.5-Medium/Large 和 FLUX.1-dev,均采用 DiT 架构。实验表明,仅需少量针对流匹配和 DiT 的调整,SiD 即可在多种模型上开箱即用,在无数据与有数据设置下均有效,无需教师模型微调或架构改动。这是首个系统性证据,表明分数蒸馏可广泛适用于文生图流匹配模型,解决了稳定性与合理性疑虑,并统一了扩散与流基生成器的加速技术。项目页:https://yigu1008.github.io/SiD-DiT
原文摘要 · Abstract (English)
Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework, has since been shown to be theoretically equivalent to diffusion under Gaussian assumptions, raising the question of whether distillation techniques such as score distillation transfer directly. We provide a simple derivation -- based on Bayes' rule and conditional expectations -- that unifies Gaussian diffusion and flow matching without relying on ODE/SDE formulations. Building on this view, we extend Score identity Distillation (SiD) to pretrained text-to-image flow-matching models, including SANA, SD3-Medium, SD3.5-Medium/Large, and FLUX.1-dev, all with DiT backbones. Experiments show that, with only modest flow-matching- and DiT-specific adjustments, SiD works out of the box across these models, in both data-free and data-aided settings, without requiring teacher finetuning or architectural changes. This provides the first systematic evidence that score distillation applies broadly to text-to-image flow matching models, resolving prior concerns about stability and soundness and unifying acceleration techniques across diffusion- and flow-based generators. A project page is available at https://yigu1008.github.io/SiD-DiT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。