arXiv:2502.13081cs.CV2025-02综述被引 22

系统梳理十年来个性化图像生成技术,理清方法演进脉络。

Personalized Image Generation with Deep Generative Models: A Decade Survey

  • 构建统一框架,整合反演空间、方法与个性化方案
  • 覆盖GAN、扩散模型等主流生成架构的个性化技术
  • 适合研究者快速掌握领域进展与未来方向

近年来生成模型的发展显著推动了个性化内容创作。给定少量包含用户特定概念的图像,个性化图像生成可创建符合指定概念和文本描述的图像。由于其在内容创作中的广泛应用,该领域近年受到广泛关注。然而,个性化技术随生成模型的发展而演进,具有不同但相互关联的组件。本文综述了各类生成模型(包括传统GAN、现代文生图扩散模型及新兴多模态自回归模型)中的通用个性化图像生成技术。首先提出一个统一框架,标准化不同生成模型的个性化流程,涵盖反演空间、反演方法与个性化方案三个关键部分。该框架为分析与比较不同架构的个性化方法提供结构化路径。基于此框架,深入分析各生成模型中的个性化技术,揭示其独特贡献。通过对比分析,阐明当前个性化图像生成的技术格局,识别共性与差异。最后讨论领域开放挑战并提出未来研究方向。相关工作持续追踪见:https://github.com/csyxwei/Awesome-Personalized-Image-Generation。

原文摘要 · Abstract (English)

Recent advancements in generative models have significantly facilitated the development of personalized content creation. Given a small set of images with user-specific concept, personalized image generation allows to create images that incorporate the specified concept and adhere to provided text descriptions. Due to its wide applications in content creation, significant effort has been devoted to this field in recent years. Nonetheless, the technologies used for personalization have evolved alongside the development of generative models, with their distinct and interrelated components. In this survey, we present a comprehensive review of generalized personalized image generation across various generative models, including traditional GANs, contemporary text-to-image diffusion models, and emerging multi-model autoregressive models. We first define a unified framework that standardizes the personalization process across different generative models, encompassing three key components, i.e., inversion spaces, inversion methods, and personalization schemes. This unified framework offers a structured approach to dissecting and comparing personalization techniques across different generative architectures. Building upon this unified framework, we further provide an in-depth analysis of personalization techniques within each generative model, highlighting their unique contributions and innovations. Through comparative analysis, this survey elucidates the current landscape of personalized image generation, identifying commonalities and distinguishing features among existing methods. Finally, we discuss the open challenges in the field and propose potential directions for future research. We keep tracing related works at https://github.com/csyxwei/Awesome-Personalized-Image-Generation.

个性化生成图像生成综述扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。