arXiv:2604.12273cs.LGcs.CV2026-04被引 1

解决生成模型多样性下降问题,让单步生成覆盖更多细节变体。

SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation

论文配图:SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation
图 1 · 摘自论文原文
  • 通过语义聚类拆分类别为细粒度子模式,用子模式索引条件化流匹配。
  • 在ImageNet-256上实现更高生成多样性(Recall提升),同时保持良好图像质量(FID接近原模型)。
  • 可直接嵌入现有单步生成模型,无需修改结构,适配性强。

流匹配已成为强大的生成框架,近期的少步方法实现了显著的推理加速。然而,我们发现一个关键却被忽视的局限:这些模型存在严重的多样性退化,样本过度集中在主导模式上,忽略目标分布中稀有但有效的变体。我们追溯此退化根源为平均偏差:当使用MSE目标训练时,类别条件流学习的是类内子模式的频率加权均值,导致高密度模式被过度代表,而低密度模式被系统性忽略。为此,我们提出SubFlow——子模式条件流匹配,通过语义聚类将每个类别分解为细粒度子模式,并以子模式索引作为条件。每个条件子分布近似单峰,因此学习到的流能无平均偏差地精准对齐各个模式,恢复单步推理下的完整模式覆盖。关键的是,SubFlow完全即插即用,可无缝集成至现有单步模型如MeanFlow和Shortcut Models,无需任何架构修改。在ImageNet-256上的大量实验表明,SubFlow在保持竞争性图像质量(FID)的同时,显著提升了生成多样性(Recall),证实其在不同单步生成框架中的广泛适用性。

原文摘要 · Abstract (English)

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity degradation, concentrating samples on dominant modes while neglecting rare but valid variations of the target distribution. We trace this degradation to averaging distortion: when trained with MSE objectives, class-conditional flows learn a frequency-weighted mean over intra-class sub-modes, causing the model to over-represent high-density modes while systematically neglecting low-density ones. To address this, we propose SubFlow, Sub-mode Conditioned Flow Matching, which eliminates averaging distortion by decomposing each class into fine-grained sub-modes via semantic clustering and conditioning the flow on sub-mode indices. Each conditioned sub-distribution is approximately unimodal, so the learned flow accurately targets individual modes with no averaging distortion, restoring full mode coverage in a single inference step. Crucially, SubFlow is entirely plug-and-play: it integrates seamlessly into existing one-step models such as MeanFlow and Shortcut Models without any architectural modifications. Extensive experiments on ImageNet-256 demonstrate that SubFlow yields substantial gains in generation diversity (Recall) while maintaining competitive image quality (FID), confirming its broad applicability across different one-step generation frameworks. Project page: https://yexionglin.github.io/subflow.

生成模型流匹配多样性提升单步生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。