arXiv:2601.01487cs.CVcs.AI2026-01

无需标注噪声,用自监督方法快速准确还原扩散模型中的噪声。

DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversion

  • 设计自监督目标与数据增强生成伪噪声,避免依赖真实标注。
  • 在COCO数据集上比EasyInv高40.435%的SSIM,推理速度提升9887.5倍。
  • 首个可训练的逐步求解器,适合需要高效可控图像编辑的研究者。

扩散反演是恢复扩散模型中图像噪声的任务,对可控图像编辑至关重要。当前该任务因缺乏有效监督信号而面临挑战,多数方法依赖近似解法,往往牺牲性能或效率。为此,本文提出一种新型自监督扩散反演方法DeepInv。不同于需真实噪声标注的方法,DeepInv引入自监督目标与数据增强策略,从真实图像自动生成高质量伪噪声,无需人工干预。基于此,构建了迭代多尺度训练机制,训练一个参数化反演求解器,实现快速精准的图像到噪声映射。据我们所知,这是首次提出可训练的逐步求解器进行扩散反演。大量实验表明,DeepInv在性能和速度上均显著优于对比方法:在COCO数据集上,相比EasyInv提升40.435% SSIM,相比ReNoise提速9887.5倍。其可训练求解器的设计也为社区提供了新思路。代码与模型参数将公开于https://github.com/potato-kitty/DeepInv。

原文摘要 · Abstract (English)

Diffusion inversion is a task of recovering the noise of an image in a diffusion model, which is vital for controllable diffusion image editing. At present, diffusion inversion still remains a challenging task due to the lack of viable supervision signals. Thus, most existing methods resort to approximation-based solutions, which however are often at the cost of performance or efficiency. To remedy these shortcomings, we propose a novel self-supervised diffusion inversion approach in this paper, termed Deep Inversion (DeepInv). Instead of requiring ground-truth noise annotations, we introduce a self-supervised objective as well as a data augmentation strategy to generate high-quality pseudo noises from real images without manual intervention. Based on these two innovative designs, DeepInv is also equipped with an iterative and multi-scale training regime to train a parameterized inversion solver, thereby achieving the fast and accurate image-to-noise mapping. To the best of our knowledge, this is the first attempt of presenting a trainable solver to predict inversion noise step by step. The extensive experiments show that our DeepInv can achieve much better performance and inference speed than the compared methods, e.g., +40.435% SSIM than EasyInv and +9887.5% speed than ReNoise on COCO dataset. Moreover, our careful designs of trainable solvers can also provide insights to the community. Codes and model parameters will be released in https://github.com/potato-kitty/DeepInv.

扩散模型自监督学习图像编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。