发现扩散模型重建误差源于内在不稳定性,与数值误差无关。
Instability in Diffusion ODEs: An Explanation for Inaccurate Image Reconstruction
- 从概率流微分方程本质出发,揭示生成分布稀疏性导致的固有不稳定性。
- 实验与理论证明:维度越高,不稳定性概率趋近1,误差被显著放大。
- 适用于研究扩散模型重建失效机制的科研人员和算法优化者。
扩散重建在图像编辑、修复和风格迁移等任务中至关重要。理论上,只需数值求解概率流常微分方程(PF-ODE)即可实现逆向重建与再生。然而实践中,仍存在显著重建误差,且无法用数值误差解释。本文揭示了PF-ODE生成过程中的深层内在特性——不稳定性,该特性会进一步放大重建误差。其根源在于生成分布的固有稀疏性:概率集中于零散且极小的区域,其余大部分几乎为空。通过在模拟实例及主流开源扩散模型上的实验,我们验证了不稳定性及其对重建误差的放大作用。基于图像数据特性,我们理论上证明:随着数据维度升高,该不稳定性概率收敛至1。研究揭示了基于扩散模型重建的固有挑战,并为未来改进提供重要启示。
原文摘要 · Abstract (English)
Diffusion reconstruction plays a critical role in various applications such as image editing, restoration, and style transfer. In theory, the reconstruction should be simple - it just inverts and regenerates images by numerically solving the Probability Flow-Ordinary Differential Equation (PF-ODE). Yet in practice, noticeable reconstruction errors have been observed, which cannot be well explained by numerical errors. In this work, we identify a deeper intrinsic property in the PF-ODE generation process, the instability, that can further amplify the reconstruction errors. The root of this instability lies in the sparsity inherent in the generation distribution, which means that the probability is concentrated on scattered and small regions while the vast majority remains almost empty. To demonstrate the existence of instability and its amplification on reconstruction error, we conduct experiments on both toy numerical examples and popular open-sourced diffusion models. Furthermore, based on the characteristics of image data, we theoretically prove that the instability's probability converges to one as the data dimensionality increases. Our findings highlight the inherent challenges in diffusion-based reconstruction and can offer insights for future improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。