arXiv:2602.12624cs.LGcs.CV2026-02被引 3

提出新采样框架,让扩散模型生成更快更准

Formalizing the Sampling Design Space of Diffusion-Based Generative Models via Adaptive Solvers and Wasserstein-Bounded Timesteps

  • 用几何视角设计自适应求解器与时间步,匹配扩散过程特性
  • 在不训练的前提下,CIFAR-10 FID达1.93,函数计算量更低
  • 适合追求高效高质生成的开发者和研究者

基于扩散的生成模型在多个领域表现优异,但实际部署常受采样成本高限制。以往工作多关注训练目标或单一求解器,而采样设计中求解器选择与调度仍依赖静态启发式。本文从几何角度重新审视该问题,提出SDM框架,将数值求解器与扩散轨迹的内在性质对齐。通过分析ODE动态,发现早期高噪声阶段低阶求解器已足够,后期则可逐步引入高阶求解器以应对增强的非线性。此外,提出基于Wasserstein误差约束的调度优化框架,系统推导出显式限制局部离散误差的自适应时间步,确保采样过程忠实于连续动力学。无需额外训练或结构修改,SDM在标准基准上达到领先性能:CIFAR-10 FID为1.93,FFHQ为2.41,AFHQv2为1.98,且函数评估次数少于现有采样器。代码已开源。

原文摘要 · Abstract (English)

Diffusion-based generative models have achieved remarkable performance across various domains, yet their practical deployment is often limited by high sampling costs. While prior work focuses on training objectives or individual solvers, the holistic design of sampling, specifically solver selection and scheduling, remains dominated by static heuristics. In this work, we revisit this challenge through a geometric lens, proposing SDM, a principled framework that aligns the numerical solver with the intrinsic properties of the diffusion trajectory. By analyzing the ODE dynamics, we show that efficient low-order solvers suffice in early high-noise stages while higher-order solvers can be progressively deployed to handle the increasing non-linearity of later stages. Furthermore, we formalize the scheduling by introducing a Wasserstein-bounded optimization framework. This method systematically derives adaptive timesteps that explicitly bound the local discretization error, ensuring the sampling process remains faithful to the underlying continuous dynamics. Without requiring additional training or architectural modifications, SDM achieves state-of-the-art performance across standard benchmarks, including an FID of 1.93 on CIFAR-10, 2.41 on FFHQ, and 1.98 on AFHQv2, with a reduced number of function evaluations compared to existing samplers. Our code is available at https://github.com/aiimaginglab/sdm.

扩散模型采样优化生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。