arXiv:2506.19839cs.CVcs.AI2025-06NeurIPS被引 7

用分层流匹配提升图像视频生成质量,无需复杂架构。

Improving Progressive Generation with Decomposable Flow Matching

  • 在多尺度表示上独立应用流匹配,实现分层生成。
  • ImageNet-1k上FDD得分提升26.4%~35.2%,训练成本不变。
  • 兼容现有训练流程,适合大模型微调加速。

高维视觉数据生成计算开销大,常用渐进式生成方法以粗到精的自回归方式合成输出。尽管扩散模型受益于去噪过程的粗细结构,但显式多阶段架构仍较少采用,因引入额外复杂性,如定制扩散形式、依赖分解的阶段转换、临时采样器或模型级联。本文提出分层流匹配(Decomposable Flow Matching, DFM),一种简单高效的视觉媒体渐进生成框架。DFM在用户定义的多尺度表示(如拉普拉斯金字塔)各层级独立应用流匹配。实验表明,该方法显著提升图像与视频的视觉质量,优于已有多阶段框架。在ImageNet-1k 512px上,相比基线架构,FDD得分提升35.2%;相较最佳基线,提升26.4%,且训练算力相同。应用于大模型微调(如FLUX)时,可更快收敛至训练分布。所有优势均以单一模型、极简架构和极少修改现有训练流程实现。

原文摘要 · Abstract (English)

Generating high-dimensional visual modalities is a computationally intensive task. A common solution is progressive generation, where the outputs are synthesized in a coarse-to-fine spectral autoregressive manner. While diffusion models benefit from the coarse-to-fine nature of denoising, explicit multi-stage architectures are rarely adopted. These architectures have increased the complexity of the overall approach, introducing the need for a custom diffusion formulation, decomposition-dependent stage transitions, add-hoc samplers, or a model cascade. Our contribution, Decomposable Flow Matching (DFM), is a simple and effective framework for the progressive generation of visual media. DFM applies Flow Matching independently at each level of a user-defined multi-scale representation (such as Laplacian pyramid). As shown by our experiments, our approach improves visual quality for both images and videos, featuring superior results compared to prior multistage frameworks. On Imagenet-1k 512px, DFM achieves 35.2% improvements in FDD scores over the base architecture and 26.4% over the best-performing baseline, under the same training compute. When applied to finetuning of large models, such as FLUX, DFM shows faster convergence speed to the training distribution. Crucially, all these advantages are achieved with a single model, architectural simplicity, and minimal modifications to existing training pipelines.

生成模型流匹配多尺度扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。