仅用一对图像即可训练图像编辑模型,提升泛化能力。
Delta-Adapter: Scalable Exemplar-Based Image Editing with Single-Pair Supervision

- 通过语义差分编码源图到目标图的变换,注入预训练模型。
- 在四个基准上优于现有方法,未见编辑任务也表现更好。
- 无需额外配对数据,适合大规模图像编辑训练。
示例式图像编辑通过源-目标图像对定义变换,并应用于新查询图像。现有方法依赖成对监督,需两组共享相同编辑语义的图像对来学习目标变换,导致数据难收集且泛化受限。本文提出Delta-Adapter,可在单对监督下学习可迁移的编辑语义,无需文本引导。不直接输入示例对,而是利用预训练视觉编码器提取源图与目标图之间的语义差分(semantic delta),并通过基于Perceiver的适配器注入预训练编辑模型。由于目标图像从未被模型直接看见,可作为预测目标,实现单对监督,无需额外示例对。该设定可直接利用现有大规模编辑数据集进行训练。为提升变换转移的准确性,引入语义差分一致性损失,使生成输出的语义变化与真实语义差分对齐。大量实验表明,Delta-Adapter在四个强基线模型上均显著提升编辑准确率与内容一致性,并在未见编辑任务上展现出更强泛化能力。
原文摘要 · Abstract (English)
Exemplar-based image editing applies a transformation defined by a source-target image pair to a new query image. Existing methods rely on a pair-of-pairs supervision paradigm, requiring two image pairs sharing the same edit semantics to learn the target transformation. This constraint makes training data difficult to curate at scale and limits generalization across diverse edit types. We propose Delta-Adapter, a method that learns transferable editing semantics under single-pair supervision, requiring no textual guidance. Rather than directly exposing the exemplar pair to the model, we leverage a pre-trained vision encoder to extract a semantic delta that encodes the visual transformation between the two images. This semantic delta is injected into a pre-trained image editing model via a Perceiver-based adapter. Since the target image is never directly visible to the model, it can serve as the prediction target, enabling single-pair supervision without requiring additional exemplar pairs. This formulation allows us to leverage existing large-scale editing datasets for training. To further promote faithful transformation transfer, we introduce a semantic delta consistency loss that aligns the semantic change of the generated output with the ground-truth semantic delta extracted from the exemplar pair. Extensive experiments demonstrate that Delta-Adapter consistently improves both editing accuracy and content consistency over four strong baselines on seen editing tasks, while also generalizing more effectively to unseen editing tasks. Code will be available at https://delta-adapter.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。