arXiv:2506.02221cs.CVcs.LG2025-06CVPR被引 35

将扩散模型知识高效迁移到流匹配模型,实现快速生成与高精度兼顾。

Diff2Flow: Training Flow Matching Models via Diffusion Model Alignment

  • 通过时间步重标定与插值对齐,实现扩散与流匹配的统一建模
  • 在参数高效约束下,生成质量优于直接微调的流匹配模型
  • 适合需要快速推理和迁移学习的生成任务开发者使用

扩散模型凭借高质量生成效果革新了生成任务,而流匹配(FM)则具备更快推理速度和实证性能优势。然而现有基础流匹配模型微调计算成本过高,而如Stable Diffusion等扩散模型则受益于高效架构与生态支持。本文提出Diff2Flow框架,通过重标定时间步、对齐插值路径,并从扩散模型预测中推导出兼容流匹配的速度场,系统性地连接扩散与流匹配范式。该对齐机制使扩散先验可直接、高效地进行流匹配微调,且无需额外计算开销。实验表明,在参数高效约束下,Diff2Flow显著优于朴素流匹配与扩散模型微调方法,在多种下游任务中达到或超越当前最优性能。代码将于https://github.com/CompVis/diff2flow公开。

原文摘要 · Abstract (English)

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for finetuning, while diffusion models like Stable Diffusion benefit from efficient architectures and ecosystem support. This work addresses the critical challenge of efficiently transferring knowledge from pre-trained diffusion models to flow matching. We propose Diff2Flow, a novel framework that systematically bridges diffusion and FM paradigms by rescaling timesteps, aligning interpolants, and deriving FM-compatible velocity fields from diffusion predictions. This alignment enables direct and efficient FM finetuning of diffusion priors with no extra computation overhead. Our experiments demonstrate that Diff2Flow outperforms naïve FM and diffusion finetuning particularly under parameter-efficient constraints, while achieving superior or competitive performance across diverse downstream tasks compared to state-of-the-art methods. We will release our code at https://github.com/CompVis/diff2flow.

生成模型流匹配扩散模型知识迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。