arXiv:2502.02483cs.LGstat.ML2025-02ICML被引 24

用评分规则学习噪声数据的完整分布,大幅加速扩散模型推理。

Distributional Diffusion Models with Scoring Rules

  • 不只预测去噪均值,而是学习完整后验分布
  • 少步数下生成质量优于传统扩散模型
  • 适合需要快速采样的图像与机器人轨迹生成

扩散模型通过连续时间前向过程逐步添加高斯噪声直至数据完全破坏,再通过反向过程从高斯样本逐步去噪生成数据。但高质量生成需大量离散步骤,计算成本高。本文提出不再仅估计条件均值,而是学习给定噪声样本下干净数据的完整后验分布。通过将标准回归损失替换为评分规则,可在粗粒度时间尺度上采样反向过程的概率转移,显著加速推理且输出质量下降极小。在图像与机器人轨迹生成任务中验证,少步数下性能持续优于标准扩散模型。

原文摘要 · Abstract (English)

Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted. The corresponding reverse process progressively "denoises" a Gaussian sample into a sample from the data distribution. However, generating high-quality outputs requires many discretization steps to obtain a faithful approximation of the reverse process. This is expensive and has motivated the development of many acceleration methods. We propose to accomplish sample generation by learning the posterior {\em distribution} of clean data samples given their noisy versions, instead of only the mean of this distribution. This allows us to sample from the probability transitions of the reverse process on a coarse time scale, significantly accelerating inference with minimal degradation of the quality of the output. This is accomplished by replacing the standard regression loss used to estimate conditional means with a scoring rule. We validate our method on image and robot trajectory generation, where we consistently outperform standard diffusion models at few discretization steps.

扩散模型生成模型加速推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。