arXiv:2605.19256cs.CV2026-05被引 1

无需额外分数网络,用生成器自身模拟反向分布修正。

Distribution Matching Distillation without Fake Score Network

论文配图:Distribution Matching Distillation without Fake Score Network
图 1 · 摘自论文原文
  • 用生成器的伪速度替代假分数网络,实现无额外组件的分布匹配蒸馏。
  • 在ImageNet-1K上达到更低FID,优于有假分数网络的DMD2基线。
  • 适用于流映射初始化和从零训练,适合追求轻量高效生成模型的研究者。

分布匹配蒸馏(DMD)能有效修正少步生成中的分布偏差,但依赖辅助的假分数网络追踪生成分布演化。近期工作将DMD目标与流映射生成器结合,同时利用前向发散训练和反向修正。然而,假分数估计器仍带来内存与更新开销。本文研究在生成器具有流映射结构时,是否可避免显式追踪器。提出无假分数网络的DMD(FSF-DMD),将辅助假分数估计器替换为生成器诱导的伪速度代理。核心观察是:流映射生成器终点的伪速度可作为假速度估计的可计算代理,使生成器自身提供反向发散信号。基于此,推导出实用目标函数,引入与流映射一致的反向模拟,并设计自教师变体以支持从零训练。在ImageNet-1K $256 \times 256$ 实验中,FSF-DMD提升流映射基线性能,在流映射初始化设置下,FID低于列出的DMD2对比方法;且在流匹配初始化和从零训练下仍保持有效性。

原文摘要 · Abstract (English)

Distribution Matching Distillation (DMD) provides an effective distribution-level correction for few-step generation, while relying on an auxiliary fake-score network to track the evolving generative distribution. Recent work combines DMD-style objectives with flow-map generators to exploit both forward-divergence training and reverse-divergence correction. The fake-score estimator remains an additional component with memory and update overhead. In this work, we study whether this explicit tracker can be avoided when the generator itself has a flow-map structure. We propose Fake-Score-network-Free DMD (FSF-DMD), a DMD formulation for flow-map generators that replaces the auxiliary fake-score estimator with a generator-induced pseudo-velocity surrogate. The key observation is that the endpoint pseudo-velocity of a flow-map generator provides a tractable proxy for fake-velocity estimation, allowing the generator itself to supply the reverse-divergence signal. Building on this observation, we derive a practical objective, extend it with flow-map-consistent backward simulation, and introduce a self-teacher variant for training from scratch. In our ImageNet-1K $256 \times 256$ experiments, FSF-DMD improves flow-map baselines, reaches lower FID than the listed DMD2 comparisons in the flow-map-initialized setting, and remains effective under flow-matching initialization and training from scratch.

分布匹配生成模型流映射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。