arXiv:2605.11773cs.LGcs.AI2026-05

挑战扩散模型采样必须单调降噪的惯例,发现非单调方案无效甚至有害。

Is Monotonic Sampling Necessary in Diffusion Models?

论文配图:Is Monotonic Sampling Necessary in Diffusion Models?
图 1 · 摘自论文原文
  • 设计四类非单调噪声调度,测试三种模型在90种配置下的表现
  • 所有非单调方案均劣于单调基线,惩罚幅度差近三个数量级
  • 提出可量化模型缺陷的调度敏感系数,为评估模型质量提供新工具

扩散模型通过迭代去噪高斯先验生成样本,现有采样器均采用单调递减的噪声水平序列。六年来,从污染算子、训练目标、调度形状、架构到常微分方程求解器,各个环节已被充分优化,但单调性假设从未被系统检验。本文探究单调性是否为必要条件而非惯例。设计四类结构化非单调调度,应用于三种不同架构的生成模型(DDPM、EDM、Flow Matching),在CIFAR-10上测试了10至200次函数评估(NFE)预算,以及42个超参数组合。在全部90种配置中,无一非单调调度优于单调基线。惩罚幅度跨度近三个数量级:在DDPM中显著且持久,在Flow Matching中居中,在EDM中几乎可忽略。该差异非随机噪声,而是由各训练去噪器的结构性质决定,由此提出调度敏感系数(Schedule Sensitivity Coefficient),一种低成本、与架构无关的诊断指标,可指示关键噪声水平下未收敛至贝叶斯最优去噪器。研究结果验证了领域对单调调度的隐含依赖,并提供了一种互补于FID等样本质量指标的新模型评估工具。

原文摘要 · Abstract (English)

Diffusion models generate samples by iteratively denoising a Gaussian prior, traversing a sequence of noise levels that, in every published sampler, decreases monotonically. Six years of intensive work has refined nearly every aspect of this recipe, including the corruption operator, the training objective, the schedule shape, the architecture, and the ODE solver. Yet the assumption of monotonicity itself has never been systematically tested. Here we ask whether monotonic sampling is load-bearing or merely conventional. We design four families of structured nonmonotonic schedules and apply them to three architecturally distinct generative models, DDPM, EDM, and Flow Matching, across NFE budgets ranging from 10 to 200 function evaluations, plus a 42-cell hyperparameter ablation, on CIFAR-10. Across all 90 tested configurations, no tested nonmonotonic schedule improves on the monotonic baseline. The magnitude of the penalty, however, spans nearly three orders of magnitude: persistent and substantial in DDPM, intermediate in Flow Matching, and indistinguishable from zero in EDM. We show that this variation is not noise but a structural property of each trained denoiser, and we formalize it as the Schedule Sensitivity Coefficient, a cheap, architecture-agnostic diagnostic that provides evidence of non-convergence to the Bayes-optimal denoiser at the critical noise level. Our findings justify the field's tacit reliance on monotonic schedules and supply a new probe of diffusion model quality complementary to sample-quality metrics such as Frechet Inception Distance.

扩散模型采样调度模型评估去噪器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。