arXiv:2511.20410cs.CV2025-11

无需训练数据,直接从生成轨迹提取信息,实现高效扩散模型加速。

Image-Free Timestep Distillation via Continuous-Time Consistency with Trajectory-Sampled Pairs

  • 从教师模型生成轨迹中直接提取隐表示,不依赖外部数据集。
  • 一歩生成下达6.52 FID与28.08 CLIP分数,训练时间减少40%。
  • 适合资源受限场景,为高效扩散模型部署提供新思路。

时间步蒸馏是提升扩散模型生成效率的有效方法。一致性模型(CM)作为基于轨迹的框架,凭借其坚实的理论基础和高质量的少步生成表现展现出巨大潜力。然而,当前连续时间一致性蒸馏方法仍严重依赖训练数据和计算资源,限制了其在资源受限场景中的部署,并阻碍了向多样化领域的扩展。为此,我们提出轨迹反向一致性模型(TBCM),通过直接从教师模型的生成轨迹中提取隐表示,消除对外部训练数据的依赖。与传统方法需使用VAE编码和大规模数据集不同,我们的自包含蒸馏范式显著提升了效率与简洁性。此外,轨迹提取样本自然弥合了训练与推理之间的分布差距,从而实现更有效的知识迁移。实验表明,TBCM在MJHQ-30k数据集上一歩生成达到6.52 FID和28.08 CLIP得分,相比Sana-Sprint训练时间减少约40%,大幅节省GPU内存,展现了卓越的效率而不牺牲质量。我们进一步揭示了连续时间一致性蒸馏中扩散-生成空间的偏差问题,并分析采样策略对蒸馏性能的影响,为未来蒸馏研究提供了洞见。

原文摘要 · Abstract (English)

Timestep distillation is an effective approach for improving the generation efficiency of diffusion models. The Consistency Model (CM), as a trajectory-based framework, demonstrates significant potential due to its strong theoretical foundation and high-quality few-step generation. Nevertheless, current continuous-time consistency distillation methods still rely heavily on training data and computational resources, hindering their deployment in resource-constrained scenarios and limiting their scalability to diverse domains. To address this issue, we propose Trajectory-Backward Consistency Model (TBCM), which eliminates the dependence on external training data by extracting latent representations directly from the teacher model's generation trajectory. Unlike conventional methods that require VAE encoding and large-scale datasets, our self-contained distillation paradigm significantly improves both efficiency and simplicity. Moreover, the trajectory-extracted samples naturally bridge the distribution gap between training and inference, thereby enabling more effective knowledge transfer. Empirically, TBCM achieves 6.52 FID and 28.08 CLIP scores on MJHQ-30k under one-step generation, while reducing training time by approximately 40% compared to Sana-Sprint and saving a substantial amount of GPU memory, demonstrating superior efficiency without sacrificing quality. We further reveal the diffusion-generation space discrepancy in continuous-time consistency distillation and analyze how sampling strategies affect distillation performance, offering insights for future distillation research. GitHub Link: https://github.com/hustvl/TBCM.

扩散模型蒸馏高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。