arXiv:2508.03142cs.CV2025-08被引 7

无需训练的闭环图像编辑,让模型自己理解、修改、验证结果。

UniEdit-I: Training-free Image Editing for Unified VLM via Iterative Understanding, Editing and Verifying

  • 在语义潜空间内循环执行理解-编辑-验证,实现动态闭环。
  • 在GEdit-Bench上达到顶尖效果,无需微调或结构改动。
  • 适合需要精准可控图像编辑的研究者与开发者。

统一视觉语言模型虽能结合视觉语言模型的高层语义理解与扩散模型的生成保真度,但现有编辑方法仍为静态、开环操作,缺乏语义理解与视觉生成间的动态反馈。核心瓶颈在于表征鸿沟:理解依赖高层、语言对齐的编码器,而生成依赖低层、像素空间的自编码器,导致特征空间不匹配。近期研究如表示自编码器和BLIP3-o主张直接在预训练语义编码器的高层特征中进行扩散建模。我们发现,在语义潜空间中编辑会改变概念表征而非像素,确保中间结果既语义连贯又视觉合理。基于此洞察,我们提出UniEdit-I,首个无需训练、闭环运行的图像编辑框架,完全在统一视觉语言模型的语义潜空间中通过引入理解-编辑-验证(UEV)循环实现。该框架将视觉语言模型从事后评估者转变为过程协作者,首次建立语义驱动、自我修正的闭环图像编辑流水线。在GEdit-Bench上的评估显示,UniEdit-I无需任何微调或架构修改即达最先进水平,甚至超越多个大规模预训练编辑器。

原文摘要 · Abstract (English)

While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies remain fundamentally decoupled and open loop performing static, pre-defined transformations without dynamic feedback between semantic interpretation and visual generation. A central limitation stems from the representation gap: understanding typically leverages high-level, language aligned encoders, whereas generation relies on low level, pixel-space autoencoders, resulting in misaligned feature spaces. To bridge this gap, Recent advances such as Representation Autoencoders and BLIP3-o advocate performing diffusion-based modeling directly in high level features from pretrained semantic encoders. We find editing in the semantic latent space modifies conceptual representations rather than pixels, ensuring intermediates that are both semantically coherent and visually plausible. Building on this insight, We propose UniEdit-I, the first training-free, closed-loop image editing framework that operates entirely within the semantic latent space of a unified VLM by introducing an Understanding-Editing-Verifying (UEV) loop, By transforming the VLM from a posthoc evaluator into an in-process conductor, UniEdit-I establishes the first semantics-driven, self-correcting closed-loop image editing pipeline. Evaluated on GEdit-Bench, UniEdit-I achieves state of the art performance without any fine tuning or architectural modifications, and even surpasses several largescale pretrained editors.

图像编辑闭环系统语义空间无需训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。