测试非高斯噪声下扩散模型性能,揭示高斯性关键作用
The relative importance of being Gaussian
- 用均匀分布、贝塔分布等非高斯噪声替代标准高斯噪声
- 在小尺寸图像和低算力设备上验证算法性能下降明显
- 强调高斯噪声假设对扩散模型有效性至关重要
使用扩散模型进行图像去噪的显著成果,源于对独立同分布标准正态随机变量序列的关键性质的数学支撑。这些推导依赖于高斯分布仅由均值和方差决定,且两个高斯变量之和仍为高斯分布。本文探讨:若不修改算法,仅将噪声替换为均匀分布、贝塔分布或方差差异大的双高斯混合噪声,算法表现如何?实验在小型笔记本电脑和最小图像尺寸下完成。结果表明,当噪声偏离高斯性时,算法性能显著下降。后续研究可探索不同场景下的鲁棒性变化。
原文摘要 · Abstract (English)
The remarkable results for denoising in computer vision using diffusion models given in \cite{SDWMG,HJA,HHG} yield a robust mathematical justification for algorithms based on crucial properties of a sequence of Gaussian independent $N(0,1)$ random variables. In particular the derivations use the fact that a Gaussian distribution is determined by its mean and variance and that the sum of two Gaussians is another Gaussian. \bigskip The issue raised in this short note is the following: suppose we use the algorithm without any changes but replace the nature of the noise and use, for instance, uniformly distributed noise or noise with a Beta distribution, or noise which is a random superposition of two Gaussians with very different variances. One could, of course, try to modify the algorithm keeping in mind the nature of the noise, but this is not what we do. Instead we study the performance of the algorithm when used with noise that is very far in nature from the Gaussian case, where it is designed to work well. Usually these algorithms are implemented on very powerful computers. Our experiments are all carried out on a small laptop and for the smallest possible image size. Exploring how our observations are confirmed or changed when dealing in different situations remains an interesting challenge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。