arXiv:2605.07661cs.LGcs.CV2026-05

无需教师模型,一步完成扩散模型加速推理。

Stochastic Transition-Map Distillation for Fast Probabilistic Inference

论文配图:Stochastic Transition-Map Distillation for Fast Probabilistic Inference
图 1 · 摘自论文原文
  • 用条件均值流建模扩散过程的完整转移路径。
  • 在MNIST/CIFAR-10/CelebA上实现快速且保概率的采样。
  • 适合需要随机推理的任务如逆问题与能量调优。

扩散模型生成质量高、多样性好、分布覆盖广,但推理成本高昂。本文提出无教师模型的随机转移图蒸馏(STMD),在保持概率采样能力的同时加速扩散模型推理。不同于基于得分的扩散模型仅建模后验均值,STMD蒸馏采样随机微分方程(SDE)的完整转移图,采用条件均值流参数化这些转移,得到只需一步或少数几步的随机采样器,保留了原始扩散过程的转移结构。该方法特别适用于需随机推理的下游任务,如扩散后验采样、反问题求解和基于能量的微调。相比现有蒸馏方法,STMD无需预训练教师模型、双层优化或轨迹模拟与缓存,支持高效可扩展训练。本文推导了方法在Wasserstein距离下的收敛界,提供理论保障,并在MNIST、CIFAR-10和CelebA数据集上验证了其有效性。

原文摘要 · Abstract (English)

Diffusion models achieve strong generation quality, diversity, and distribution coverage, but their performance often comes with expensive inference. In this work, we propose Stochastic Transition-Map Distillation (STMD), a teacher-free framework for accelerating diffusion model inference while preserving probabilistic sample generation. In contrast to score-based diffusion models, whose denoising parametrization models the mean of the posterior distribution, STMD distills the full transition map associated with the sampling stochastic differential equation (SDE). We parameterize these SDE transitions with a conditional Mean Flow model, yielding a one- or few-step stochastic sampler that retains the transition structure of the underlying diffusion process. This perspective is especially useful for downstream tasks that require stochastic inference, such as diffusion posterior sampling, inverse problems, and energy-based fine-tuning. Compared to recent distillation methods, STMD requires no pretrained teacher, bi-level optimization, or trajectory simulation and caching, enabling efficient and scalable training. We derive convergence bounds for our method in the Wasserstein distance, providing a strong theoretical foundation for our approach, and validate STMD on various image generation examples on the MNIST, CIFAR-10, and CelebA datasets.

扩散模型加速推理随机采样无教师蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。