让扩散模型采样更高效,自动聚焦变化快的区域。
Sharpen Your Flow: Sharpness-Aware Sampling for Flow Matching

- 通过分析速度场变化剧烈处,动态分配采样步数。
- 相同计算量下,生成样本更清晰,覆盖更多模式。
- 无需训练,可直接用于已有模型,适合快速部署。
流匹配模型通过数值积分学习到的速度场生成样本,每一步都需要神经网络评估。快速生成的关键在于如何高效利用固定的评估预算:不仅要考虑如何积分流,还要决定采样器在何处分配步数。我们提出SharpEuler,一种无需训练的采样方法,通过离线分析预训练模型,在校准轨迹上估计速度场变化最剧烈的位置。该有限差分估计构建了与求解器相关的锐度轮廓,经平滑和分位数变换后转化为任意推理预算下的时间步网格。测试时,采样仍采用普通欧拉积分,模型评估次数与均匀调度相同。我们基于三项原则验证SharpEuler:数值原则指出轨迹加速度是欧拉离散误差的主要来源;变分原则推导出基于锐度的幂律时间步密度;统计保证证明有限样本校准后的采样器在终端分布层面稳定。实验表明,SharpEuler在固定预算下提升样本质量,减少模态泄漏并增加模态覆盖率。
原文摘要 · Abstract (English)
Flow matching models generate samples by numerically integrating a learned velocity field, with each integration step requiring a neural network evaluation. Fast generation therefore requires using a small fixed evaluation budget effectively: the key question is not only how to integrate the flow, but where the sampler should spend its steps. We propose SharpEuler, a training-free sampler that profiles a pretrained model offline by estimating where the learned velocity field changes most rapidly along calibration trajectories. This finite-difference estimate defines a solver-aware sharpness profile, which is smoothed and converted by a quantile transform into a timestep grid for any desired inference budget. At test time, sampling remains ordinary Euler integration with the same number of model evaluations as a uniform schedule. We justify SharpEuler using three principles: a numerical principle identifying trajectory acceleration as the leading source of Euler discretization error, a variational principle deriving sharpness-based power-law timestep densities, and a statistical guarantee showing that the finite-sample calibrated sampler is stable at the terminal distribution level. Our experiments show that SharpEuler improves sample quality at fixed budgets, reducing inter-mode leakage and increasing mode coverage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。