arXiv:2503.16025cs.CVcs.AI2025-03被引 1

仅用一张图就能高质量生成和编辑人物,无需训练。

Single Image Iterative Subject-driven Generation and Editing

  • 通过迭代优化相似度损失,直接调整生成模型参数。
  • 在单图条件下,生成质量与主体保真度显著优于现有方法。
  • 无需训练,可适配任意图像生成器,适合快速个性化应用。

仅凭少量甚至单张主体图像进行个性化图像生成与编辑极具挑战。现有方法依赖概念学习,但图像质量随样本减少而下降;预训练编码器虽能提升质量,却受限于训练分布且耗时。本文提出SISO,一种无需训练的新方法,基于输入主体图像的相似度分数进行迭代优化。SISO通过不断生成图像并调整模型以最小化与目标图像的差异,实现即插即用的个性化。我们在多样化的个人主体数据集上评估了SISO在图像编辑与生成任务中的表现,结果表明其在图像质量、主体保真度及背景保留方面均显著优于现有方法。

原文摘要 · Abstract (English)

Personalizing image generation and editing is particularly challenging when we only have a few images of the subject, or even a single image. A common approach to personalization is concept learning, which can integrate the subject into existing models relatively quickly, but produces images whose quality tends to deteriorate quickly when the number of subject images is small. Quality can be improved by pre-training an encoder, but training restricts generation to the training distribution, and is time consuming. It is still an open hard challenge to personalize image generation and editing from a single image without training. Here, we present SISO, a novel, training-free approach based on optimizing a similarity score with an input subject image. More specifically, SISO iteratively generates images and optimizes the model based on loss of similarity with the given subject image until a satisfactory level of similarity is achieved, allowing plug-and-play optimization to any image generator. We evaluated SISO in two tasks, image editing and image generation, using a diverse data set of personal subjects, and demonstrate significant improvements over existing methods in image quality, subject fidelity, and background preservation.

图像生成个性化无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。