arXiv:2606.01380cs.CV2026-06中稿 · Pattern Recognitio…被引 1

无需训练即可实现高效图像逆向生成与编辑,提升扩散模型精度与速度。

Training-free image inversion for one-step diffusion models

论文配图:Training-free image inversion for one-step diffusion models
图 1 · 摘自论文原文
  • 通过迭代噪声对齐与后缀学习,解决初始潜在变量与理想分布的偏差问题。
  • 在PIE-Bench上达到当前最优编辑效果,效率远超多步方法。
  • 适合需要快速图像编辑且无训练资源的研究者与应用开发者。

本文提出一种无需训练的图像逆向生成框架TFinv,针对单步扩散模型中的真实图像逆向与编辑难题。我们识别出两大关键障碍:初始潜在可编辑性(初始噪声与理想高斯分布的距离)和文本描述间隙(文本提示与图像表征的对齐程度)。为此,提出两种新方法:迭代噪声对齐(iterNA),最小化分布差异以逼近标准高斯分布;以及后缀学习(suffL),通过引入可学习的后缀提示词增强文本-图像对齐。该框架可精确将输入图像逆向为初始噪声,并支持图像编辑。此外,提出基于掩码的局部编辑技术,在保持背景完整性的前提下实现精准修改。在PIE-Bench数据集上的全面实验表明,TFinv不仅在单步扩散编辑中达到领先性能,且显著优于现有多步方法的效率。代码已开源。

原文摘要 · Abstract (English)

In this work, we introduce a novel training-free inversion (TFinv) framework for one-step diffusion models,addressing key challenges in real image inversion and editing. We first identify two critical factors hamperingreal-image inversion and editing: (1) Initial Latent Editability, which is related to the distance between theinitial noise and the ideal Gaussian distribution, and (2) Caption Gap, which means the alignment betweentext captions and image representations. Both factors influence inversion efficiency and the editability ofone-step diffusion models. Then, we propose two novel techniques: iterative noise alignment (iterNA), whichminimizes the distribution gap to align with the normal Gaussian distribution, and suffix learning (suffL),which enhances text-to-image caption alignment by introducing learned suffix prompt tokens. These techniquesenable precise inversion of input images into their initial noise representations and facilitate image editing.Furthermore, we propose a mask-based editing technique for localized edits while preserving backgroundintegrity. Comprehensive experiments on the PIE-Bench dataset validate that our method TFinv not onlyachieves state-of-the-art performance in one-step diffusion editing, but also significantly outperforms existingmultistep approaches in efficiency. The code is available at https://github.com/tttao-uwu/TFinv.git.

图像逆向扩散模型无需训练图像编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。