arXiv:2604.25128cs.CV2026-04

让生成图像可精准编辑,重用初始潜空间提升细节保真度

ResetEdit: Precise Text-guided Editing of Generated Image via Resettable Starting Latent

论文配图:ResetEdit: Precise Text-guided Editing of Generated Image via Resettable Starting Latent
图 1 · 摘自论文原文
  • 在生成过程嵌入可恢复的潜空间信息,实现编辑锚点回溯
  • 重建潜空间逼近真实起点,使局部修改保持结构一致
  • 无需额外训练,兼容现有编辑方法,适合需要高精度控制的场景

扩散模型已实现高质量图像生成,对生成后局部编辑的需求日益增长。精确编辑需高质量起始潜空间,兼顾多样性与细粒度控制。但现有基于反演的方法(如DDIM反演)生成的潜空间质量不佳,导致编辑保真度下降、结构不一致。理想情况下,应使用生成时的原始潜空间作为编辑锚点,因其天然包含场景结构与语义。然而,存储每张图的原始潜空间因存储与检索成本过高而不可行。为此,我们提出ResetEdit,一种主动式扩散编辑框架,将可恢复的潜空间信息直接嵌入生成过程。通过在扩散轨迹中注入干净与噪声潜空间的差异,并在反演时提取该差异,重构出接近真实起始状态的可重置潜空间。此外,轻量级潜空间优化模块补偿了由VAE非对称性引起的重建偏差。基于Stable Diffusion,ResetEdit可无缝集成现有无调优编辑方法,在可控性与视觉保真度上持续优于当前最优基线。

原文摘要 · Abstract (English)

Recent advances in diffusion models have enabled high-quality image generation, leading to increasing demand for post-generation editing that modifies local regions while preserving global structure. Achieving such flexible and precise editing requires a high-quality starting point, a latent representation that provides both the freedom needed for diverse modifications and the precision required for fine-grained, region-specific control. However, existing inversion-based approaches such as DDIM inversion often yield unsatisfactory starting latents, resulting in degraded edit fidelity and structural inconsistency. Ideally, the most suitable editing anchor should be the original latent used during the generation process, as it inherently captures the scene's structure and semantics. Yet, storing this latent for every generated image is impractical due to massive storage and retrieval costs. To address this challenge, we propose ResetEdit, a proactive diffusion editing framework that embeds recoverable latent information directly into the generation process. By injecting the discrepancy between the clean and diffused latents into the diffusion trajectory and extracting it during inversion, ResetEdit reconstructs a resettable latent that closely approximates the true starting state. Additionally, a lightweight latent optimization module compensates for reconstruction bias caused by VAE asymmetry. Built upon Stable Diffusion, ResetEdit integrates seamlessly with existing tuning-free editing methods and consistently outperforms state-of-the-art baselines in both controllability and visual fidelity.

图像编辑扩散模型潜空间重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。