arXiv:2512.02636cs.LGcs.CV2025-12被引 16

让流模型采样和似然计算都提速100倍,且保持高质量生成。

Joint Distillation for Fast Likelihood Evaluation and Sampling in Flow-based Models

  • 共享速度场联合蒸馏采样与似然计算路径
  • 采样和似然评估均降至仅需数步神经网络求值
  • 适合追求高效生成与精确似然的科研与工程应用

对生成模型而言,对数似然评估支持模型比较、特定微调目标及多种下游任务。然而,当前最先进的生成模型——扩散模型和流模型——仍需数百至数千次神经网络函数求值(NFE)才能计算一次似然。尽管近期蒸馏方法已将采样加速至仅数步,但代价是放弃似然可计算性:现有方法或完全舍弃似然计算,或仍需对完整轨迹进行昂贵积分。本文提出快速流联合蒸馏(F2D2),通过共享的底层速度场,使采样轨迹与累积散度的联合蒸馏仅用一个流映射即可实现,将采样与似然评估的NFE数均降低两个数量级。该框架模块化,兼容现有少步采样流模型,仅需额外增加一个发散预测头。实验表明,F2D2在仅数步评估下仍能获得准确对数似然并保持高样本质量,解决了流模型长期存在的计算瓶颈。作为应用,我们提出一种轻量自引导方法,使两步MeanFlow性能超越1024步流匹配模型,仅需一次额外反向NFE。

原文摘要 · Abstract (English)

Log-likelihood evaluation enables important capabilities in generative models, including model comparison, certain fine-tuning objectives, and many downstream applications. Yet paradoxically, some of today's best generative models -- diffusion and flow-based models -- still require hundreds to thousands of neural function evaluations (NFEs) to compute a single likelihood. While recent distillation methods have successfully accelerated sampling to just a few steps, they achieve this at the cost of likelihood tractability: existing approaches either abandon likelihood computation entirely or still require expensive integration over full trajectories. We present fast flow joint distillation (F2D2), a framework that simultaneously reduces the number of NFEs required for both sampling and likelihood evaluation by two orders of magnitude. Our key insight is that in continuous normalizing flows, the coupled ODEs for sampling and likelihood are computed from a shared underlying velocity field, allowing us to jointly distill both the sampling trajectory and cumulative divergence using a single flow map. F2D2 is modular, compatible with existing flow-based few-step sampling models, and requires only an additional divergence prediction head. Experiments demonstrate F2D2's capability of achieving accurate log-likelihood with few-step evaluations while maintaining high sample quality, solving a long-standing computational bottleneck in flow-based generative models. As an application of our approach, we propose a lightweight self-guidance method that enables a 2-step MeanFlow to outperform a 1024 step flow matching model with only a single additional backward NFE.

流模型蒸馏生成模型似然评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。