arXiv:2601.10708cs.LGmath.ST2026-01被引 7

提出新型扩散采样方法,精度高且不随维度增长。

High-accuracy and dimension-free sampling with diffusions

  • 结合低阶逼近与配点法设计新求解器
  • 迭代次数仅对精度呈多对数依赖,且与维度无关
  • 适合高维数据高精度采样,如图像生成

扩散模型在从复杂多模态分布中采样方面表现出显著的实证成功。其推断依赖于数值求解特定微分方程,该方程无法解析求解,通常需大量小步迭代才能生成高质量样本。以往工作表明,离散化方法的迭代复杂度随环境维度和精度倒数 $1/ au$ 呈多项式增长。本文提出一种新求解器,利用低阶逼近与配点法(Lee, Song, Vempala 2018)的微妙协同作用,证明其迭代复杂度在 $1/ au$ 上仅呈多对数依赖,首次实现仅需(近似)数据分布得分信息即可达到高精度采样的理论保证。此外,该界不显式依赖环境维度;维度仅通过目标分布支撑集的‘有效半径’影响复杂度。

原文摘要 · Abstract (English)

Diffusion models have shown remarkable empirical success in sampling from rich multi-modal distributions. Their inference relies on numerically solving a certain differential equation. This differential equation cannot be solved in closed form, and its resolution via discretization typically requires many small iterations to produce \emph{high-quality} samples. More precisely, prior works have shown that the iteration complexity of discretization methods for diffusion models scales polynomially in the ambient dimension and the inverse accuracy $1/\varepsilon$. In this work, we propose a new solver for diffusion models relying on a subtle interplay between low-degree approximation and the collocation method (Lee, Song, Vempala 2018), and we prove that its iteration complexity scales \emph{polylogarithmically} in $1/\varepsilon$, yielding the first ``high-accuracy'' guarantee for a diffusion-based sampler that only uses (approximate) access to the scores of the data distribution. In addition, our bound does not depend explicitly on the ambient dimension; more precisely, the dimension affects the complexity of our solver through the \emph{effective radius} of the support of the target distribution only.

扩散模型采样算法高维分析理论保证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。