arXiv:2606.15389cs.CV2026-06中稿 · ICML

改进扩散模型反演的采样步数调度,提升图像重建精度。

Timestep Rescheduling in Diffusion Inversion

  • 发现反演误差随时间步大小呈抛物线分布,两端误差最大。
  • 设计非均匀调度策略,全局缩放结合局部动态规划优化计算分配。
  • 无需额外参数或计算开销,可直接提升现有反演方法性能。

扩散反演将图像映射回扩散模型的高斯隐空间,是图像重建与编辑的关键任务。尽管DDIM实现快速确定性反演,但其固有偏差会累积导致明显反演误差。现有方法多通过求解固定点问题缓解,却忽略了噪声调度中扩散时间步选择对反演保真度的影响。本文揭示:反演偏差规模强烈依赖于时间步大小,呈现抛物线趋势,小和大时间步处误差显著。基于此,提出一种简单有效的非均匀时间步调度器,融合全局缩放与局部动态规划重调度,实现计算资源的战略分配,最小化整体反演误差并保持更高精度。该方法作为即插即用增强方案,不引入额外参数或计算开销。大量实验表明,集成本调度器能持续提升现有反演方法性能,在图像重建与编辑任务中取得更优结果。

原文摘要 · Abstract (English)

Diffusion inversion, which maps images back to the Gaussian latent space of a diffusion model, is a critical task for image reconstruction and editing. While DDIM enables fast deterministic inversion, it inherently introduces deviations that accumulate into noticeable inversion errors. Existing methods often address this by solving a fixed-point problem but largely overlook how the selection of the diffusion timestep in the noise scheduler influences inversion fidelity. In this work, we reveal that the deviation scale in diffusion inversion is strongly dependent on the timestep size, and exhibits a parabolic trend, with larger errors concentrated at both small and large timesteps. Based on this finding, we propose a simple yet effective nonuniform timestep scheduler that integrates a global rescaling with a local dynamic programming based rescheduling, enabling a strategic allocation of computational effort that minimizes the overall inversion error and preserves higher inversion accuracy. Our method serves as an off-the-shelf enhancement for existing inversion techniques and requires no extra parameters or computational overhead. Through extensive experiments, we verify that integrating our scheduler consistently boosts the performance of existing inversion methods, achieving superior results in image reconstruction and editing.

扩散模型反演调度优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。