提出无需迭代的扩散反演方法,提升图像重建效率与精度。
An Iteration-Free Fixed-Point Estimator for Diffusion Inversion
- 基于前步误差近似,推导出可计算的固定点估计式。
- 在NOCAPS和MS-COCO上优于DDIM等方法,无额外迭代或训练。
- 理论证明低方差无偏,适合高精度图像重建场景。
扩散反演旨在恢复给定图像对应的初始噪声,使该噪声可通过去噪扩散过程重建原图。其核心是每一步最小化重构误差,以缓解累积误差。近期固定点迭代被广泛采用,但存在计算开销大、超参数选择复杂等问题。为此,我们提出一种无需迭代的固定点估计器。首先从理想反演步骤推导出固定点的显式表达式,但其包含未知的数据预测误差。基于此,引入误差近似机制,利用前一步可计算的误差来近似当前步未知误差,从而获得可计算的近似固定点表达式。理论分析表明该估计器为无偏且方差低。在两个文本-图像数据集NOCAPS和MS-COCO上评估,相比DDIM反演及其他基于固定点迭代的方法,本方法在无需额外迭代或训练的情况下,持续实现更优的重构性能。
原文摘要 · Abstract (English)
Diffusion inversion aims to recover the initial noise corresponding to a given image such that this noise can reconstruct the original image through the denoising diffusion process. The key component of diffusion inversion is to minimize errors at each inversion step, thereby mitigating cumulative inaccuracies. Recently, fixed-point iteration has emerged as a widely adopted approach to minimize reconstruction errors at each inversion step. However, it suffers from high computational costs due to its iterative nature and the complexity of hyperparameter selection. To address these issues, we propose an iteration-free fixed-point estimator for diffusion inversion. First, we derive an explicit expression of the fixed point from an ideal inversion step. Unfortunately, it inherently contains an unknown data prediction error. Building upon this, we introduce the error approximation, which uses the calculable error from the previous inversion step to approximate the unknown error at the current inversion step. This yields a calculable, approximate expression for the fixed point, which is an unbiased estimator characterized by low variance, as shown by our theoretical analysis. We evaluate reconstruction performance on two text-image datasets, NOCAPS and MS-COCO. Compared to DDIM inversion and other inversion methods based on the fixed-point iteration, our method achieves consistent and superior performance in reconstruction tasks without additional iterations or training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。