arXiv:2604.04018cs.CV2026-04被引 3

突破扩散模型蒸馏的步数限制,实现1.7步高效高质生成。

1.x-Distill: Breaking the Diversity, Quality, and Efficiency Barrier in Distribution Matching Distillation

  • 提出分数步蒸馏框架,打破整数步约束,支持1.67~1.74步生成。
  • 在SD3模型上实现33倍加速,质量与多样性超越现有方法。
  • 适合追求快速生成且不牺牲图像质量的研究者和开发者。

扩散模型生成高质量文生图结果,但其迭代去噪过程计算成本高。分布匹配蒸馏(DMD)成为少步蒸馏的有前景路径,但在减少至两步或更少时面临多样性崩溃和保真度下降问题。本文提出1.x-Distill,首个突破先前少步方法整数步限制的分数步蒸馏框架,将1.x步生成确立为可实用的蒸馏扩散模型范式。具体而言,我们首先分析教师端CFG在DMD中被忽视的作用,引入简单有效的改进以抑制模式崩溃;其次,为提升极端步数下的性能,提出分阶段聚焦蒸馏(Stagewise Focused Distillation),通过保留多样性的分布匹配学习粗结构,并利用推理一致的对抗蒸馏细化细节;此外,设计轻量补偿模块,将块级缓存自然融入蒸馏流程。在SD3-Medium和SD3.5-Large上的实验表明,1.x-Distill优于现有少步方法,在1.67和1.74有效NFE下分别实现更优质量与多样性,相比原始28×2 NFE采样最高提速33倍。

原文摘要 · Abstract (English)

Diffusion models produce high-quality text-to-image results, but their iterative denoising is computationally expensive.Distribution Matching Distillation (DMD) emerges as a promising path to few-step distillation, but suffers from diversity collapse and fidelity degradation when reduced to two steps or fewer. We present 1.x-Distill, the first fractional-step distillation framework that breaks the integer-step constraint of prior few-step methods and establishes 1.x-step generation as a practical regime for distilled diffusion models.Specifically, we first analyze the overlooked role of teacher CFG in DMD and introduce a simple yet effective modification to suppress mode collapse. Then, to improve performance under extreme steps, we introduce Stagewise Focused Distillation, a two-stage strategy that learns coarse structure through diversity-preserving distribution matching and refines details with inference-consistent adversarial distillation. Furthermore, we design a lightweight compensation module for Distill--Cache co-Training, which naturally incorporates block-level caching into our distillation pipeline.Experiments on SD3-Medium and SD3.5-Large show that 1.x-Distill surpasses prior few-step methods, achieving better quality and diversity at 1.67 and 1.74 effective NFEs, respectively, with up to 33x speedup over original 28x2 NFE sampling.

扩散模型蒸馏高效生成图像质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。