arXiv:2503.06558cs.LGstat.ML2025-03被引 6

用跳跃噪声改进生成模型,提升图像合成质量

Generative modelling with jump-diffusions

  • 引入带泊松跳跃的非高斯噪声建模生成过程
  • 跳跃幅度服从拉普拉斯分布时,性能优于传统高斯模型
  • 方法简单可扩展,适合需要高质量生成的应用场景

基于得分的扩散模型通过反向扩散过程从未知目标分布生成样本。尽管这类模型在工业图像生成中已达顶尖水平,但近期研究表明,引入重尾特征的注入噪声可进一步提升性能。本文将生成扩散过程推广至一类广泛的非高斯噪声过程,考虑由标准高斯噪声叠加泊松跳跃构成的有限活动莱维过程作为前向过程。生成过程由依赖跳跃幅度分布的广义得分函数支配,可通过最小化简单MSE损失进行估计,与传统高斯模型一致。基于基本技术推导出概率流ODE和SDE形式。针对拉普拉斯跳跃幅度的纯跳跃过程,得到广义得分函数的闭式解析表达,并在特定参数范围内表现优于等效高斯模型。

原文摘要 · Abstract (English)

Score-based diffusion models generate samples from an unknown target distribution using a time-reversed diffusion process. While such models represent state-of-the-art approaches in industrial applications such as artificial image generation, it has recently been noted that their performance can be further improved by considering injection noise with heavy tailed characteristics. Here, I present a generalization of generative diffusion processes to a wide class of non-Gaussian noise processes. I consider forward processes driven by standard Gaussian noise with super-imposed Poisson jumps representing a finite activity Levy process. The generative process is shown to be governed by a generalized score function that depends on the jump amplitude distribution and can be estimated by minimizing a simple MSE loss as in conventional Gaussian models. Both probability flow ODE and SDE formulations are derived using basic technical effort. A detailed implementation for a pure jump process with Laplace distributed amplitudes yields a generalized score function in closed analytical form and is shown to outperform the equivalent Gaussian model in specific parameter regimes.

生成模型扩散模型跳跃过程得分网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。