arXiv:2509.22454cs.LG2025-09被引 2

提出新方法加速静电生成模型,用少次计算实现接近甚至超越原模型的图像生成质量。

Overclocking Electrostatic Generative Models

  • 将知识蒸馏转化为逆问题,学习能复现教师模型电场的生成器。
  • 在有限维度下仅需少量函数求值即可达到接近或超过教师模型的生成质量。
  • 适用于希望快速生成高质量图像的研究者和开发者,尤其适合资源受限场景。

静电生成模型(如 PFGM++)最近成为强大的图像合成框架,在有限维度 D 下表现优异,其理论极限为 D→∞ 时恢复扩散模型。与扩散模型类似,PFGM++ 依赖昂贵的 ODE 求解进行采样,计算成本高。为此,本文提出逆泊松流匹配(IPFM),一种普适的蒸馏框架,可加速所有 D 值下的静电生成模型。IPFM 将蒸馏重构为逆问题:学习一个生成器,使其诱导的电场匹配教师模型。我们推导出可训练的目标函数,并证明当 D→∞ 时,IPFM 近似恢复近期的得分恒等蒸馏(SiD)方法。实验表明,所提方法生成的蒸馏生成器仅用少数函数评估即可达到近教师或更优的样本质量。此外,发现有限 D 下的一步蒸馏收敛更快,与已有研究一致:有限维 PFGM++ 模型具有更优的优化与采样特性。

原文摘要 · Abstract (English)

Electrostatic generative models such as PFGM++ have recently emerged as a powerful framework, achieving competitive performance in image synthesis. PFGM++ operates in an extended data space with auxiliary dimensionality $D$, recovering the diffusion model framework as $D\to\infty$, while yielding superior empirical results for finite $D$. Like diffusion models, PFGM++ relies on expensive ODE simulations to generate samples, making it computationally costly. To address this, we propose Inverse Poisson Flow Matching (IPFM), a principled distillation framework that accelerates electrostatic generative models across all values of $D$. Our IPFM reformulates distillation as an inverse problem: learning a generator whose induced electrostatic field matches that of the teacher. We derive a tractable training objective for this problem and show that, as $D\to\infty$, our IPFM closely recovers Score Identity Distillation (SiD), a recent method for distilling diffusion models. Empirically, our IPFM produces distilled generators that achieve near-teacher or even superior sample quality using only a few function evaluations. Moreover, we find that one-step generator distillation converges faster at finite $D$ than in the $D\to\infty$ diffusion limit, aligning with prior evidence that finite-$D$ PFGM++ models offer more favorable optimization and sampling behavior.

生成模型知识蒸馏静电模型高效采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。