arXiv:2606.29287cs.LGcs.CV2026-06

改进生成模型加速方法,让少步采样也能保持高质量。

Beyond Trajectory Matching: Reflow with Marginal Distribution Alignment

论文配图:Beyond Trajectory Matching: Reflow with Marginal Distribution Alignment
图 1 · 摘自论文原文
  • 通过对齐学生与教师模型终点分布,优化生成轨迹。
  • 在3步生成上显著提升图像质量,比原方法减少20%误差。
  • 无需额外网络,通用性强,适合快速生成场景。

扩散与连续流生成模型可实现高质量生成,其确定性采样可表述为求解学习到的常微分方程(ODE)动力学。然而,高精度的ODE离散化通常需要大量步骤,因此实现高效少步生成成为关键挑战。现有加速策略中,基于reflow的蒸馏方法通过简化教师模型的轨迹,使学生模型以更少步骤逼近教师传输过程。我们发现该范式存在理论局限:轨迹匹配可能无法唯一确定学生模型诱导的分布。具体而言,两个学生模型可达到相同的轨迹匹配损失,但产生不同的终点边缘分布,进而影响生成质量。为此,我们引入一种边缘分布对齐正则项,惩罚学生模型在每个蒸馏区间终点处与教师模型边缘分布的差异。该正则项通过追踪学生模型诱导的ODE路径上的对数密度变化,并利用冻结教师模型的得分估计,无需额外可训练网络或对抗优化。所提框架可统一应用于reflow家族,包括普通reflow与分段reflow。我们进一步证明了一个望远镜式总变差界,表明局部边缘对齐可控制最终时刻学生与教师分布间的差距。在基准骨干模型上的实验验证了该方法在少步生成中的有效性。

原文摘要 · Abstract (English)

Diffusion and continuous-flow generative models achieve high-quality generation, and their deterministic sampling can be formulated as solving learned ODE dynamics. However, accurate ODE discretization often requires many steps, making efficient few-step generation a key challenge. Among acceleration strategies, reflow-based distillation simplifies teacher ODE trajectories so that a student model can approximate the teacher transport with fewer steps. We identify a theoretical limitation of this paradigm, namely that trajectory matching can under-determine the distribution induced by the student model. In particular, two student models can attain the same trajectory-matching loss while inducing different endpoint marginal distributions, which may lead to different generation quality. To address this limitation, we introduce a marginal-alignment regularizer that penalizes the discrepancy between the student-induced marginal and the corresponding teacher marginal at the endpoint of each distillation interval. The regularizer is computed by tracking log-density changes along the ODE induced by the student model and evaluating scores from the frozen teacher model, without requiring auxiliary trainable networks or adversarial optimization. The resulting framework applies uniformly to the reflow family, including vanilla reflow and piecewise reflow. We further prove a telescoping total-variation bound showing that local marginal alignment controls the final-time discrepancy between the student-induced and teacher-induced distributions. Experiments on benchmark backbones demonstrate the effectiveness of the proposed method for few-step generation.

生成模型扩散模型少步生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。